Nov 02 11:35:29 devstack cinder-volume[75795]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 11:35:29 devstack cinder-volume[75795]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 11:35:29 devstack cinder-volume[75795]: we strongly recommend against using it for new projects. Nov 02 11:35:29 devstack cinder-volume[75795]: If you are already using Eventlet, we recommend migrating to a different Nov 02 11:35:29 devstack cinder-volume[75795]: framework. For more detail see Nov 02 11:35:29 devstack cinder-volume[75795]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 11:35:29 devstack cinder-volume[75795]: import eventlet # noqa Nov 02 11:35:31 devstack cinder-volume[75795]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 11:35:31 devstack cinder-volume[75795]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 11:35:31 devstack cinder-volume[75795]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 11:35:32 devstack cinder-volume[75795]: INFO dbcounter [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Registered counter for database cinder Nov 02 11:35:32 devstack cinder-volume[75795]: DEBUG oslo_db.sqlalchemy.engines [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75795) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG dbcounter [-] [75795] Writer thread running {{(pid=75795) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 11:35:33 devstack cinder-volume[75795]: INFO cinder.rpc [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 11:35:33 devstack cinder-volume[75795]: INFO cinder.rpc [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_db.sqlalchemy.engines [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75795) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:35:33 devstack cinder-volume[75795]: INFO cinder.volume.manager [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Determined volume DB was empty at startup. Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG cinder.volume.manager [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75795) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 11:35:33 devstack cinder-volume[75795]: INFO cinder.volume.manager [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 11:35:33 devstack cinder-volume[75795]: WARNING stevedore.named [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 11:35:33 devstack cinder-volume[75795]: WARNING castellan.key_manager [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 11:35:33 devstack cinder-volume[75795]: WARNING cinder.keymgr.conf_key_mgr [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG cinder.volume.drivers.lvm [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75795) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_concurrency.processutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75795) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_concurrency.processutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] CMD "cinder-rtstool verify" returned: 0 in 0.437s {{(pid=75795) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_db.sqlalchemy.engines [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75795) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:35:33 devstack cinder-volume[75795]: INFO cinder.rpc [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 11:35:33 devstack cinder-volume[75795]: INFO cinder.rpc [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 11:35:33 devstack cinder-volume[75795]: WARNING stevedore.named [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 11:35:33 devstack cinder-volume[75795]: WARNING castellan.key_manager [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 11:35:33 devstack cinder-volume[75795]: INFO cinder.volume.manager [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_db.sqlalchemy.engines [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75795) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:35:33 devstack cinder-volume[75795]: INFO oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Starting 1 workers Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Started child 75942 {{(pid=75795) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Full set of CONF: {{(pid=75795) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] ******************************************************************************** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Configuration options gathered from: {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] ================================================================================ {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] allow_availability_zone_fallback = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] allow_compression_on_image_upload = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] allowed_direct_url_schemes = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] api_rate_limit = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] auth_strategy = keystone {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] az_cache_duration = 3600 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_availability_zone = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75942]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_host = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_stats_polling_interval = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backup_api_class = cinder.backup.api.API {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backup_name_template = backup-%s {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backup_use_same_host = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backup_use_temp_snapshot = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] chap_password = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] chap_username = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_internal_tenant_project_id = 53c4482585274017b3939df0b80ae0b9 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_internal_tenant_user_id = aa121bc5f84a49979d2ff880a3ee5fb7 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cloned_volume_same_az = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cluster = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] compression_format = gzip {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] compute_api_class = cinder.compute.nova.API {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] config_dir = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] config_source = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] control_exchange = openstack {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] debug = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] default_availability_zone = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] default_group_type = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] default_volume_type = lvmdriver-1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] disk_geometry = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] driver_client_cert = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] driver_client_cert_key = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] driver_data_namespace = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] driver_ssl_cert_path = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] driver_ssl_cert_verify = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] driver_use_ssl = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] enable_force_upload = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] enable_new_services = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] enable_unsupported_driver = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] enforce_multipath_for_image_xfer = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] filter_function = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_api_insecure = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_api_servers = ['http://192.168.122.221/image'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_api_ssl_compression = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_ca_certificates_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_catalog_info = image:glance:publicURL {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_num_retries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance_request_timeout = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] goodness_function = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] graceful_shutdown_timeout = 5 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] group_api_class = cinder.group.api.API {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] host = devstack {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_compress_on_upload = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_conversion_address_space_limit = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_conversion_cpu_limit = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_conversion_disable = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_introspection_address_space_limit = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_introspection_cpu_limit = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_upload_use_cinder_backend = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:33 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_upload_use_internal_tenant = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_volume_cache_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_volume_cache_max_count = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] image_volume_cache_max_size_gb = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] init_host_max_objects_retrieval = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] instance_format = [instance: %(uuid)s] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] iscsi_target_flags = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] iscsi_write_cache = on {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] iser_helper = tgtadm {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] iser_ip_address = 192.168.122.221 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] iser_port = 3260 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_color = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_config_append = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_dir = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_options = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_rotate_interval = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_rotate_interval_type = days {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] log_rotation_type = none {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] max_age = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] max_logfile_count = 30 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] max_logfile_size_mb = 200 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] max_over_subscription_ratio = 20.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75942]: INFO cinder.volume.manager [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] message_reap_interval = 86400 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] message_ttl = 2592000 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] migration_create_volume_timeout_secs = 300 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] monkey_patch = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] monkey_patch_modules = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] my_ip = 192.168.122.221 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] no_snapshot_gb_quota = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] num_iser_scan_tries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] num_shell_tries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] num_volume_device_scan_tries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] nvmeof_conn_info_version = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] nvmet_ns_id = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] nvmet_port_id = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] osapi_max_limit = 1000 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] osapi_volume_ext_list = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] osapi_volume_listen_port = 8776 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] osapi_volume_use_ssl = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] osapi_volume_workers = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] per_volume_size_limit = -1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] periodic_fuzzy_delay = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] periodic_interval = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] public_endpoint = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] publish_errors = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] quota_backup_gigabytes = 1000 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] quota_backups = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] quota_gigabytes = 1000 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] quota_groups = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] quota_snapshots = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] quota_volumes = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] rate_limit_burst = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] rate_limit_except_level = CRITICAL {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] rate_limit_interval = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] reinit_driver_count = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] replication_device = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] report_discard_supported = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] report_interval = 120 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] reservation_clean_interval = 86400 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] reservation_expire = 86400 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] reserved_image_namespaces = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] reserved_percentage = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] rpc_response_timeout = 120 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] run_external_periodic_tasks = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] scst_target_driver = iscsi {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] scst_target_iqn_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_down_time = 720 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] shell_completion = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] snapshot_name_template = snapshot-%s {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] snapshot_same_host = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] split_loggers = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] state_path = /opt/stack/data/cinder {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] storage_availability_zone = nova {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] storage_protocol = iSCSI {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] syslog_log_facility = LOG_USER {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] target_helper = lioadm {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] target_ip_address = 192.168.122.221 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] target_port = 3260 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] target_protocol = iscsi {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] target_secondary_ip_addresses = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] trace_flags = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] transport_url = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] until_refresh = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] use_chap_auth = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] use_default_quota_class = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] use_journal = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] use_json = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] use_multipath_for_image_xfer = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] use_stderr = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] use_syslog = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] verify_glance_signatures = enabled {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_api_class = cinder.volume.api.API {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_backend_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_clear = zero {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_clear_ionice = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_clear_size = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_copy_bps_limit = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_dd_blocksize = 1M {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_name_template = volume-%s {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_service_inithost_offload = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volume_usage_audit_period = month {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] zoning_mode = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_concurrency.disable_process_locking = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.auth_section = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.auth_type = password {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.auth_version = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.cache = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.include_service_catalog = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.insecure = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.interface = public {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_password = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcache_username = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.region_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.service_type = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.221/identity {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.backend = dogpile.cache.null {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.backend_argument = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.backend_expiration_time = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.config_prefix = cache.oslo {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.debug_cache_backend = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.enable_retry_client = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.enable_socket_keepalive = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.expiration_time = 600 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.hashclient_retry_attempts = 2 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.memcache_dead_retry = 300 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.memcache_pool_maxsize = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.memcache_sasl_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.password = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.proxies = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.redis_db = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.redis_server = localhost:6379 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.retry_attempts = 2 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.retry_delay = 0.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.socket_keepalive_count = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.socket_keepalive_idle = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.socket_keepalive_interval = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.socket_timeout = 1.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.tls_allowed_ciphers = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.tls_cafile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.tls_certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.tls_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.tls_keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cache.username = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] coordination.backend_url = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.asyncio_connection = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.asyncio_slave_connection = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.backend = sqlalchemy {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.connection = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.connection_debug = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.connection_parameters = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.connection_recycle_time = 3600 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.connection_trace = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.db_inc_retry_interval = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.db_max_retries = 20 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.db_max_retry_interval = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.db_retry_interval = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.max_overflow = 50 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.max_pool_size = 5 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.max_retries = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.mysql_wsrep_sync_wait = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.pool_timeout = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.retry_interval = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.slave_connection = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.sqlite_synchronous = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.synchronous_reader = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] database.use_db_reconnect = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_tracing.insecure = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.connection_string = messaging:// {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.es_doc_type = notification {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.es_scroll_size = 10000 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.es_scroll_time = 2m {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.filter_error_trace = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.hmac_keys = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.sentinel_service_name = mymaster {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.socket_timeout = 0.1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.trace_requests = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler.trace_sqlalchemy = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler_jaeger.process_tags = {} {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler_jaeger.service_name_prefix = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] profiler_otlp.service_name_prefix = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.enforce_new_defaults = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.policy_default_rule = default {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.policy_file = policy.yaml {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] privsep_osbrick.group = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] privsep_osbrick.helper_command = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] privsep_osbrick.user = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_sys_admin.group = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_sys_admin.helper_command = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] cinder_sys_admin.user = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack sudo[75968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.auth_section = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.auth_type = password {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.cafile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack sudo[75968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.collect_timing = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.insecure = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.send_service_user_token = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.split_loggers = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.timeout = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.tls_ciphers = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] service_user.tls_min_version = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.auth_section = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.auth_type = password {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.collect_timing = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.insecure = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.region_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.split_loggers = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.timeout = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.tls_ciphers = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] glance.tls_min_version = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.backend_availability_zone = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.chap_password = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.chap_username = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.disk_geometry = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.driver_client_cert = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.driver_client_cert_key = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.driver_data_namespace = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.driver_use_ssl = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.extra_capabilities = {} {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.filter_function = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.goodness_function = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.iscsi_target_flags = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.iscsi_write_cache = on {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.iser_helper = tgtadm {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.iser_ip_address = 192.168.122.221 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.iser_port = 3260 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.lvm_share_target = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.lvm_type = auto {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.num_shell_tries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.replication_device = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.report_discard_supported = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.reserved_percentage = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.target_helper = tgtadm {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.target_ip_address = 192.168.122.221 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.target_port = 3260 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.target_protocol = iscsi {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.trace_flags = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.unique_fqdn_network = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.use_chap_auth = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_backend_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_clear = zero {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_clear_ionice = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_clear_size = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_reports.file_event_handler = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_reports.log_dir = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.backend_host = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.chap_password = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.chap_username = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.disk_geometry = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.driver_client_cert = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.extra_capabilities = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.filter_function = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.goodness_function = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.iser_helper = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.iser_ip_address = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.iser_port = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.lvm_share_target = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.lvm_type = auto {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.num_shell_tries = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.replication_device = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.report_discard_supported = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.reserved_percentage = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.scst_target_driver = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.storage_protocol = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.target_helper = lioadm {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.target_ip_address = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.target_port = 3260 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.trace_flags = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.use_chap_auth = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_clear = zero {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_clear_size = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] lvmdriver-1.volumes_dir = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.ssl = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_notifications.driver = [] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_notifications.retry = -1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] key_manager.fixed_key = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.barbican_api_version = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.barbican_endpoint = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.barbican_endpoint_type = public {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.barbican_region_name = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.cafile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.collect_timing = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.insecure = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.number_of_retries = 60 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.retry_delay = 1 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.send_service_user_token = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.split_loggers = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.timeout = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.tls_ciphers = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.tls_min_version = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.verify_ssl = True {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican.verify_ssl_path = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.auth_section = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.auth_type = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.cafile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.certfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.collect_timing = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.insecure = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.keyfile = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.split_loggers = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.timeout = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.tls_ciphers = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] barbican_service_user.tls_min_version = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.approle_role_id = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.approle_secret_id = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.auth_method = approle {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.auth_path = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.kv_mountpoint = secret {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.kv_path = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.kv_version = 2 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.namespace = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.root_token_id = **** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.ssl_ca_crt_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.timeout = 60.0 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.token_file = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.token_role = None {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.use_ssl = False {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:35:34 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] ******************************************************************************** {{(pid=75795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 11:35:34 devstack sudo[75968]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:34 devstack sudo[76067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:34 devstack sudo[76067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:34 devstack sudo[76067]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.357s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:35:34 devstack cinder-volume[75942]: INFO cinder.brick.local_dev.lvm [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:34 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:34 devstack sudo[76152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:35:34 devstack sudo[76152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:35 devstack sudo[76152]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG cinder.brick.local_dev.lvm [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75942) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:35 devstack sudo[76237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:35 devstack sudo[76237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:35 devstack sudo[76237]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:35 devstack sudo[76406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:35 devstack sudo[76406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:35 devstack sudo[76406]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:35 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:35 devstack sudo[76482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 11:35:35 devstack sudo[76482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:36 devstack sudo[76482]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:36 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.327s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:36 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:36 devstack sudo[76567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:35:36 devstack sudo[76567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:36 devstack sudo[76567]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:36 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:36 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:36 devstack sudo[76575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:35:36 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:36 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:36 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:36 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:36 devstack sudo[76654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:35:36 devstack sudo[76654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:37 devstack sudo[76654]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:37 devstack sudo[76663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:37 devstack sudo[76663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:37 devstack sudo[76663]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:37 devstack sudo[76747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:37 devstack sudo[76747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:37 devstack sudo[76747]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:37 devstack cinder-volume[75942]: INFO cinder.volume.drivers.lvm [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:37 devstack sudo[76751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:37 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:37 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG cinder.volume.drivers.lvm [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Updating volume stats {{(pid=75942) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 11:35:37 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:37 devstack sudo[76760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:35:38 devstack sudo[76760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:38 devstack sudo[76760]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:38 devstack sudo[76763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:35:38 devstack sudo[76763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:38 devstack sudo[76763]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:38 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:38 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:38 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:38 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:35:38 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:38 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:38 devstack cinder-volume[75942]: INFO cinder.volume.driver [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 11:35:38 devstack cinder-volume[75942]: DEBUG cinder.volume.driver [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75942) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_db.sqlalchemy.engines [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75942) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG dbcounter [-] [75942] Writer thread running {{(pid=75942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG cinder.db.api [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Building query based on filter {{(pid=75942) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG cinder.image.image_utils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75942) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 11:35:39 devstack cinder-volume[75942]: INFO cinder.keymgr.migration [None req-cf87256d-12e9-41cc-a2d0-5d11232419fd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG cinder.volume.drivers.lvm [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Updating volume stats {{(pid=75942) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:39 devstack sudo[76772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:35:39 devstack sudo[76772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:39 devstack sudo[76772]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:39 devstack sudo[76775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:35:39 devstack sudo[76775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:39 devstack sudo[76775]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:39 devstack sudo[76780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:39 devstack sudo[76780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:39 devstack sudo[76780]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:39 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:39 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:35:39 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:40 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG cinder.manager [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Notifying Schedulers of capabilities ... {{(pid=75942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:35:40 devstack cinder-volume[75942]: INFO cinder.volume.manager [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Driver initialization completed successfully. Nov 02 11:35:40 devstack cinder-volume[75942]: INFO cinder.manager [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Initiating service 2 cleanup Nov 02 11:35:40 devstack cinder-volume[75942]: INFO cinder.manager [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Service 2 cleanup completed. Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG cinder.service [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Creating RPC server for service cinder-volume {{(pid=75942) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG cinder.service [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75942) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 11:35:40 devstack cinder-volume[75942]: INFO cinder.volume.manager [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG cinder.volume.drivers.lvm [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Updating volume stats {{(pid=75942) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:40 devstack sudo[76787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:35:40 devstack sudo[76787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:40 devstack sudo[76787]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:40 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:35:40 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:40 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:40 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:40 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:35:40 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:41 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:41 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.237s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:41 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:35:41 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:35:41 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:35:41 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Nov 02 11:35:41 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:35:41 devstack cinder-volume[75942]: INFO cinder.volume.manager [None req-bf123ee2-4a3a-44df-bea0-dda7a12215b0 None None] Driver post RPC initialization completed successfully. Nov 02 11:35:43 devstack cinder-volume[75795]: DEBUG dbcounter [-] [75795] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75795) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:35:48 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager._thread_info {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:35:48 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread count: 6 {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:35:48 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread info: [<_MainThread(MainThread, started 126060406034560)>, , , , , ] {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:35:51 devstack cinder-volume[75942]: DEBUG dbcounter [-] [75942] Writing DB stats cinder:SELECT=3 {{(pid=75942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:35:51 devstack cinder-volume[75942]: DEBUG dbcounter [-] [75942] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:36:48 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:36:48 devstack cinder-volume[75942]: DEBUG cinder.volume.drivers.lvm [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Updating volume stats {{(pid=75942) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 11:36:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:36:48 devstack sudo[79052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:36:48 devstack sudo[79052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:36:48 devstack sudo[79052]: pam_unix(sudo:session): session closed for user root Nov 02 11:36:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:36:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:36:48 devstack sudo[79055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:36:48 devstack sudo[79055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:36:48 devstack sudo[79055]: pam_unix(sudo:session): session closed for user root Nov 02 11:36:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:36:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:36:48 devstack sudo[79058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:36:48 devstack sudo[79058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:36:49 devstack sudo[79058]: pam_unix(sudo:session): session closed for user root Nov 02 11:36:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:36:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:36:49 devstack sudo[79061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:36:49 devstack sudo[79061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:36:49 devstack sudo[79061]: pam_unix(sudo:session): session closed for user root Nov 02 11:36:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:36:49 devstack cinder-volume[75942]: DEBUG cinder.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Notifying Schedulers of capabilities ... {{(pid=75942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:36:49 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager._thread_info {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:36:49 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread count: 6 {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:36:49 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread info: [<_MainThread(MainThread, started 126060406034560)>, , , , , ] {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:37:48 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:37:48 devstack cinder-volume[75942]: DEBUG cinder.volume.drivers.lvm [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Updating volume stats {{(pid=75942) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 11:37:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:37:48 devstack sudo[82288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:37:48 devstack sudo[82288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:37:48 devstack sudo[82288]: pam_unix(sudo:session): session closed for user root Nov 02 11:37:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:37:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:37:48 devstack sudo[82291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:37:48 devstack sudo[82291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:37:48 devstack sudo[82291]: pam_unix(sudo:session): session closed for user root Nov 02 11:37:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:37:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:37:48 devstack sudo[82310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:37:48 devstack sudo[82310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:37:49 devstack sudo[82310]: pam_unix(sudo:session): session closed for user root Nov 02 11:37:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:37:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:37:49 devstack sudo[82313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:37:49 devstack sudo[82313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:37:49 devstack sudo[82313]: pam_unix(sudo:session): session closed for user root Nov 02 11:37:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:37:49 devstack cinder-volume[75942]: DEBUG cinder.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Notifying Schedulers of capabilities ... {{(pid=75942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:37:51 devstack cinder-volume[75942]: DEBUG dbcounter [-] [75942] Writing DB stats cinder:SELECT=1 {{(pid=75942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:37:51 devstack cinder-volume[75942]: DEBUG dbcounter [-] [75942] Writing DB stats cinder:UPDATE=1 {{(pid=75942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:38:48 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:38:48 devstack cinder-volume[75942]: DEBUG cinder.volume.drivers.lvm [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Updating volume stats {{(pid=75942) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 11:38:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:38:48 devstack sudo[84444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:38:48 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:38:48 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root Nov 02 11:38:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:38:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:38:48 devstack sudo[84457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:38:48 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:38:48 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root Nov 02 11:38:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:38:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:38:48 devstack sudo[84468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:38:48 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:38:49 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root Nov 02 11:38:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:38:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:38:49 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:38:49 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:38:49 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Nov 02 11:38:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:38:49 devstack cinder-volume[75942]: DEBUG cinder.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Notifying Schedulers of capabilities ... {{(pid=75942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:38:49 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager._thread_info {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:38:49 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread count: 6 {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:38:49 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread info: [<_MainThread(MainThread, started 126060406034560)>, , , , , ] {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:39:48 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:39:48 devstack cinder-volume[75942]: DEBUG cinder.volume.drivers.lvm [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Updating volume stats {{(pid=75942) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 11:39:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:39:48 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 11:39:48 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:39:48 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Nov 02 11:39:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:39:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:39:48 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:39:48 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:39:48 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Nov 02 11:39:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:39:48 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:39:48 devstack sudo[85675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 11:39:48 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:39:49 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root Nov 02 11:39:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:39:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:39:49 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 11:39:49 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:39:49 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Nov 02 11:39:49 devstack cinder-volume[75942]: DEBUG oslo_concurrency.processutils [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75942) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:39:49 devstack cinder-volume[75942]: DEBUG cinder.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Notifying Schedulers of capabilities ... {{(pid=75942) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:39:49 devstack cinder-volume[75942]: DEBUG oslo_service.periodic_task [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] Running periodic task VolumeManager._thread_info {{(pid=75942) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:39:49 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread count: 6 {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:39:49 devstack cinder-volume[75942]: DEBUG cinder.volume.manager [None req-e42ad1e7-1478-4b94-9e23-fa18e39b02ec None None] thread info: [<_MainThread(MainThread, started 126060406034560)>, , , , , ] {{(pid=75942) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:39:51 devstack cinder-volume[75942]: DEBUG dbcounter [-] [75942] Writing DB stats cinder:SELECT=1 {{(pid=75942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:39:51 devstack cinder-volume[75942]: DEBUG dbcounter [-] [75942] Writing DB stats cinder:UPDATE=1 {{(pid=75942) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:39:54 devstack cinder-volume[75795]: INFO oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Caught SIGTERM, stopping children Nov 02 11:39:54 devstack cinder-volume[75795]: DEBUG oslo_concurrency.lockutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Acquiring lock "singleton_lock" {{(pid=75795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 11:39:54 devstack cinder-volume[75795]: DEBUG oslo_concurrency.lockutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Acquired lock "singleton_lock" {{(pid=75795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 11:39:54 devstack cinder-volume[75795]: DEBUG oslo_concurrency.lockutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Releasing lock "singleton_lock" {{(pid=75795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 11:39:54 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Stop services. {{(pid=75795) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 11:39:54 devstack cinder-volume[75795]: DEBUG oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Killing children. {{(pid=75795) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 11:39:54 devstack cinder-volume[75795]: INFO oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Waiting on 1 children to exit Nov 02 11:39:55 devstack cinder-volume[75942]: DEBUG oslo_concurrency.lockutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Acquiring lock "singleton_lock" {{(pid=75942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 11:39:55 devstack cinder-volume[75942]: DEBUG oslo_concurrency.lockutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Acquired lock "singleton_lock" {{(pid=75942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 11:39:55 devstack cinder-volume[75942]: DEBUG oslo_concurrency.lockutils [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Releasing lock "singleton_lock" {{(pid=75942) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 11:39:55 devstack cinder-volume[75942]: WARNING amqp [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 11:39:55 devstack cinder-volume[75942]: WARNING amqp [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 11:39:55 devstack cinder-volume[75795]: INFO oslo_service.backend._eventlet.service [None req-c224b8fc-2709-4c94-8dae-41e9eaf6f498 None None] Child 75942 exited with status 0 Nov 02 11:39:55 devstack cinder-volume[85990]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 11:39:55 devstack cinder-volume[85990]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 11:39:55 devstack cinder-volume[85990]: we strongly recommend against using it for new projects. Nov 02 11:39:55 devstack cinder-volume[85990]: If you are already using Eventlet, we recommend migrating to a different Nov 02 11:39:55 devstack cinder-volume[85990]: framework. For more detail see Nov 02 11:39:55 devstack cinder-volume[85990]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 11:39:55 devstack cinder-volume[85990]: import eventlet # noqa Nov 02 11:39:57 devstack cinder-volume[85990]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 11:39:57 devstack cinder-volume[85990]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 11:39:57 devstack cinder-volume[85990]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 11:39:58 devstack cinder-volume[85990]: INFO dbcounter [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Registered counter for database cinder Nov 02 11:39:58 devstack cinder-volume[85990]: DEBUG oslo_db.sqlalchemy.engines [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:39:58 devstack cinder-volume[85990]: DEBUG dbcounter [-] [85990] Writer thread running {{(pid=85990) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 11:39:58 devstack cinder-volume[85990]: INFO cinder.rpc [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 11:39:58 devstack cinder-volume[85990]: INFO cinder.rpc [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 11:39:58 devstack cinder-volume[85990]: DEBUG oslo_db.sqlalchemy.engines [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:39:58 devstack cinder-volume[85990]: INFO cinder.volume.manager [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Determined volume DB was empty at startup. Nov 02 11:39:58 devstack cinder-volume[85990]: DEBUG cinder.volume.manager [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85990) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 11:39:58 devstack cinder-volume[85990]: INFO cinder.volume.manager [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 11:39:58 devstack cinder-volume[85990]: WARNING stevedore.named [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 11:39:58 devstack cinder-volume[85990]: WARNING castellan.key_manager [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 11:39:58 devstack cinder-volume[85990]: WARNING cinder.keymgr.conf_key_mgr [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 11:39:58 devstack cinder-volume[85990]: INFO cinder.volume.manager [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 11:39:58 devstack cinder-volume[85990]: DEBUG oslo_db.sqlalchemy.engines [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:39:58 devstack cinder-volume[85990]: INFO oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Starting 1 workers Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Started child 86207 {{(pid=85990) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Full set of CONF: {{(pid=85990) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] ******************************************************************************** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Configuration options gathered from: {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] ================================================================================ {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] allow_availability_zone_fallback = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[86207]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] allow_compression_on_image_upload = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] allowed_direct_url_schemes = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] api_rate_limit = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] auth_strategy = keystone {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_availability_zone = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_host = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_stats_polling_interval = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backup_api_class = cinder.backup.api.API {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backup_name_template = backup-%s {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backup_use_same_host = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backup_use_temp_snapshot = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] chap_password = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] chap_username = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_internal_tenant_project_id = 53c4482585274017b3939df0b80ae0b9 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_internal_tenant_user_id = aa121bc5f84a49979d2ff880a3ee5fb7 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cluster = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] compression_format = gzip {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] compute_api_class = cinder.compute.nova.API {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] config_dir = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] config_source = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] control_exchange = openstack {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] debug = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] default_availability_zone = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] default_group_type = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] default_volume_type = QuobyteHD {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] disk_geometry = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] driver_client_cert = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] driver_client_cert_key = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] driver_data_namespace = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] driver_ssl_cert_path = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] driver_ssl_cert_verify = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] driver_use_ssl = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] enable_new_services = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] enable_unsupported_driver = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] enabled_backends = ['QuobyteHD'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] enforce_multipath_for_image_xfer = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] filter_function = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_api_insecure = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.remotefs [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86207) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_api_servers = ['http://192.168.122.221/image'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_api_ssl_compression = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_ca_certificates_file = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_catalog_info = image:glance:publicURL {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_num_retries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance_request_timeout = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] goodness_function = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] graceful_shutdown_timeout = 5 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] group_api_class = cinder.group.api.API {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] host = devstack {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_compress_on_upload = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_conversion_address_space_limit = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_conversion_cpu_limit = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_conversion_disable = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_introspection_address_space_limit = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_introspection_cpu_limit = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_upload_use_cinder_backend = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_upload_use_internal_tenant = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_volume_cache_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_volume_cache_max_count = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] image_volume_cache_max_size_gb = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] init_host_max_objects_retrieval = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] instance_format = [instance: %(uuid)s] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] iscsi_target_flags = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] iscsi_write_cache = on {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] iser_helper = tgtadm {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] iser_ip_address = 192.168.122.221 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] iser_port = 3260 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_color = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_config_append = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_dir = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_file = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_options = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_rotate_interval = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_rotate_interval_type = days {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] log_rotation_type = none {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] max_age = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] max_logfile_count = 30 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] max_logfile_size_mb = 200 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] max_over_subscription_ratio = 20.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] message_reap_interval = 86400 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] message_ttl = 2592000 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] migration_create_volume_timeout_secs = 300 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] monkey_patch = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] monkey_patch_modules = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] my_ip = 192.168.122.221 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] no_snapshot_gb_quota = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] num_iser_scan_tries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] num_shell_tries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] num_volume_device_scan_tries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] nvmeof_conn_info_version = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] nvmet_ns_id = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] nvmet_port_id = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] osapi_max_limit = 1000 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] osapi_volume_ext_list = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] osapi_volume_listen_port = 8776 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] osapi_volume_use_ssl = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] osapi_volume_workers = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] per_volume_size_limit = -1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] periodic_fuzzy_delay = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] periodic_interval = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] public_endpoint = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] publish_errors = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] quota_backup_gigabytes = 1000 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] quota_backups = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] quota_gigabytes = 1000 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] quota_groups = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] quota_snapshots = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] quota_volumes = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] rate_limit_burst = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] rate_limit_except_level = CRITICAL {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] rate_limit_interval = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] reinit_driver_count = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] replication_device = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] report_discard_supported = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] report_interval = 120 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] reservation_clean_interval = 86400 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] reservation_expire = 86400 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] reserved_image_namespaces = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] reserved_percentage = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] rpc_response_timeout = 120 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] run_external_periodic_tasks = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] scst_target_driver = iscsi {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] scst_target_iqn_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_down_time = 720 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] shell_completion = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] snapshot_name_template = snapshot-%s {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] split_loggers = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] state_path = /opt/stack/data/cinder {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] storage_availability_zone = nova {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] storage_protocol = iSCSI {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] syslog_log_facility = LOG_USER {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] target_helper = lioadm {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] target_ip_address = 192.168.122.221 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] target_port = 3260 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] target_protocol = iscsi {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] target_secondary_ip_addresses = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] trace_flags = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] transport_url = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] until_refresh = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] use_chap_auth = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] use_default_quota_class = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] use_journal = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] use_json = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] use_multipath_for_image_xfer = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] use_stderr = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] use_syslog = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] verify_glance_signatures = enabled {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_api_class = cinder.volume.api.API {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_backend_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_clear = zero {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_clear_ionice = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_clear_size = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_copy_bps_limit = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_dd_blocksize = 1M {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_name_template = volume-%s {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_service_inithost_offload = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volume_usage_audit_period = month {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] zoning_mode = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86207) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 11:39:59 devstack cinder-volume[86207]: WARNING cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 11:39:59 devstack cinder-volume[86207]: WARNING cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_concurrency.disable_process_locking = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.auth_section = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.auth_type = password {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.auth_version = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.cache = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Running cmd (subprocess): mount.quobyte {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.include_service_catalog = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.insecure = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.interface = public {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_password = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcache_username = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.region_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.service_type = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.221/identity {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.backend = dogpile.cache.null {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.backend_argument = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.backend_expiration_time = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.config_prefix = cache.oslo {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.debug_cache_backend = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.enable_retry_client = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.enable_socket_keepalive = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.expiration_time = 600 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.hashclient_retry_attempts = 2 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.memcache_dead_retry = 300 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.memcache_pool_maxsize = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.memcache_sasl_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.password = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.proxies = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.redis_db = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.redis_server = localhost:6379 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.retry_attempts = 2 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.retry_delay = 0.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.socket_keepalive_count = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.socket_keepalive_idle = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.socket_keepalive_interval = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.socket_timeout = 1.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.tls_allowed_ciphers = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.tls_cafile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.tls_certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.tls_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.tls_keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cache.username = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] coordination.backend_url = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.asyncio_connection = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.asyncio_slave_connection = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.backend = sqlalchemy {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.connection = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.connection_debug = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.connection_parameters = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.connection_recycle_time = 3600 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.connection_trace = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.db_inc_retry_interval = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.db_max_retries = 20 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.db_max_retry_interval = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.db_retry_interval = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.max_overflow = 50 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.max_pool_size = 5 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.max_retries = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.mysql_wsrep_sync_wait = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.pool_timeout = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.retry_interval = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.slave_connection = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.sqlite_synchronous = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.synchronous_reader = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] database.use_db_reconnect = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_tracing.insecure = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.connection_string = messaging:// {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.es_doc_type = notification {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.es_scroll_size = 10000 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.es_scroll_time = 2m {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.filter_error_trace = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.hmac_keys = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.sentinel_service_name = mymaster {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.socket_timeout = 0.1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.trace_requests = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler.trace_sqlalchemy = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler_jaeger.process_tags = {} {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler_jaeger.service_name_prefix = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] profiler_otlp.service_name_prefix = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.enforce_new_defaults = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.policy_default_rule = default {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.policy_file = policy.yaml {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] privsep_osbrick.group = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] privsep_osbrick.helper_command = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] privsep_osbrick.user = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_sys_admin.group = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_sys_admin.helper_command = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] cinder_sys_admin.user = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.auth_section = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.auth_type = password {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.cafile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.collect_timing = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.insecure = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.send_service_user_token = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.split_loggers = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.timeout = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.tls_ciphers = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] service_user.tls_min_version = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.auth_section = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.auth_type = password {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.collect_timing = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.insecure = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.region_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.split_loggers = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.timeout = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.tls_ciphers = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] glance.tls_min_version = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.backend_availability_zone = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.chap_password = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.chap_username = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.disk_geometry = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.driver_client_cert = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.driver_client_cert_key = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.driver_data_namespace = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack quobyte-client[86208]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 11:39:59 devstack quobyte-client[86208]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.driver_use_ssl = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.extra_capabilities = {} {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.filter_function = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.goodness_function = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.iscsi_target_flags = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.iscsi_write_cache = on {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.iser_helper = tgtadm {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.iser_ip_address = 192.168.122.221 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.iser_port = 3260 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_host = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_login = admin {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_mount_options = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_password = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_private_key = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[86207]: INFO cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf ... Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 -c /etc/quobyte/client-cinder.cfg {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_share_path = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.num_shell_tries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.quobyte_volume_url = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.replication_device = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.report_discard_supported = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.reserved_percentage = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.target_helper = tgtadm {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.target_ip_address = 192.168.122.221 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.target_port = 3260 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.target_protocol = iscsi {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.trace_flags = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.unique_fqdn_network = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.use_chap_auth = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_backend_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_clear = zero {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_clear_ionice = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_clear_size = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_reports.file_event_handler = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_reports.log_dir = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.backend_availability_zone = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.backend_host = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.chap_password = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.chap_username = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.chiscsi_conf = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.disk_geometry = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.driver_client_cert = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.driver_data_namespace = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.driver_use_ssl = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.extra_capabilities = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.filter_function = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.goodness_function = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 -c /etc/quobyte/client-cinder.cfg Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.iser_helper = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.iser_ip_address = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.iser_port = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.iser_target_prefix = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_host = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_login = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_mount_options = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_password = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_private_key = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_share_path = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_ssh_port = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.num_shell_tries = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.nvmet_port_id = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.replication_device = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.report_discard_supported = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.reserved_percentage = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.scst_target_driver = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.storage_protocol = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.target_helper = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.target_ip_address = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.target_port = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.target_prefix = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.target_protocol = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.trace_flags = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.use_chap_auth = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_clear = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_clear_size = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] QuobyteHD.volumes_dir = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.ssl = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_notifications.driver = [] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_notifications.retry = -1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] key_manager.fixed_key = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.barbican_api_version = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.barbican_endpoint = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.barbican_endpoint_type = public {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.barbican_region_name = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.cafile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.collect_timing = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.insecure = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.number_of_retries = 60 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.retry_delay = 1 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.send_service_user_token = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.split_loggers = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.timeout = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.tls_ciphers = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.tls_min_version = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.verify_ssl = True {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican.verify_ssl_path = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.auth_section = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.auth_type = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.cafile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.certfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.collect_timing = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.insecure = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.keyfile = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.split_loggers = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.timeout = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.tls_ciphers = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] barbican_service_user.tls_min_version = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.approle_role_id = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.approle_secret_id = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.auth_method = approle {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.auth_path = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.kv_mountpoint = secret {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.kv_path = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.kv_version = 2 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.namespace = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.root_token_id = **** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.ssl_ca_crt_file = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.timeout = 60.0 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.token_file = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.token_role = None {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.use_ssl = False {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:39:59 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] ******************************************************************************** {{(pid=85990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 11:39:59 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.442s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:39:59 devstack cinder-volume[86207]: INFO cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf succeeded Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.456s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:39:59 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:39:59 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:39:59 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:40:00 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.238s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:00 devstack cinder-volume[86207]: INFO cinder.volume.driver [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Driver hasn't implemented _init_vendor_properties() Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.volume.driver [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8525581359863, 'free_capacity_gb': 1773.8525581359863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86207) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_db.sqlalchemy.engines [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG dbcounter [-] [86207] Writer thread running {{(pid=86207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.db.api [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Building query based on filter {{(pid=86207) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.image.image_utils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86207) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 11:40:00 devstack cinder-volume[86207]: INFO cinder.keymgr.migration [None req-062b9f06-cb94-4cb2-bea9-f1506bde49e6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:40:00 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:40:00 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:40:00 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.228s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.manager [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Notifying Schedulers of capabilities ... {{(pid=86207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:40:00 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Driver initialization completed successfully. Nov 02 11:40:00 devstack cinder-volume[86207]: INFO cinder.manager [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Initiating service 3 cleanup Nov 02 11:40:00 devstack cinder-volume[86207]: INFO cinder.manager [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Service 3 cleanup completed. Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.service [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Creating RPC server for service cinder-volume {{(pid=86207) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.service [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86207) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 11:40:00 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:40:00 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:40:00 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:40:00 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Nov 02 11:40:00 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.275s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:00 devstack cinder-volume[86207]: INFO cinder.volume.manager [None req-b825c1be-c1a8-4101-a805-c6049fbf5e2b None None] Driver post RPC initialization completed successfully. Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG cinder.volume.drivers.quobyte [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:40:05 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:40:05 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:40:05 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG oslo_concurrency.processutils [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.223s {{(pid=86207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:05 devstack cinder-volume[86207]: DEBUG cinder.manager [None req-801a592b-1967-4ae9-9361-d18742c96e7e None None] Notifying Schedulers of capabilities ... {{(pid=86207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:40:08 devstack cinder-volume[85990]: INFO oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Caught SIGTERM, stopping children Nov 02 11:40:08 devstack cinder-volume[85990]: DEBUG oslo_concurrency.lockutils [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Acquiring lock "singleton_lock" {{(pid=85990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 11:40:08 devstack cinder-volume[85990]: DEBUG oslo_concurrency.lockutils [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Acquired lock "singleton_lock" {{(pid=85990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 11:40:08 devstack cinder-volume[85990]: DEBUG oslo_concurrency.lockutils [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Releasing lock "singleton_lock" {{(pid=85990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 11:40:08 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Stop services. {{(pid=85990) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 11:40:08 devstack cinder-volume[85990]: DEBUG oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Killing children. {{(pid=85990) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 11:40:08 devstack cinder-volume[85990]: INFO oslo_service.backend._eventlet.service [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Waiting on 1 children to exit Nov 02 11:40:10 devstack cinder-volume[86207]: DEBUG dbcounter [-] [86207] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:40:10 devstack cinder-volume[86207]: DEBUG dbcounter [-] [86207] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:40:13 devstack cinder-volume[86207]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 02 11:40:13 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Acquiring lock "singleton_lock" {{(pid=86207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 11:40:13 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Acquired lock "singleton_lock" {{(pid=86207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 11:40:13 devstack cinder-volume[86207]: DEBUG oslo_concurrency.lockutils [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Releasing lock "singleton_lock" {{(pid=86207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 11:40:13 devstack cinder-volume[86207]: WARNING amqp [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 11:40:13 devstack cinder-volume[86207]: WARNING amqp [None req-9dd8a01d-516e-4f57-b808-59f641ec0073 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 11:40:14 devstack cinder-volume[86549]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 11:40:14 devstack cinder-volume[86549]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 11:40:14 devstack cinder-volume[86549]: we strongly recommend against using it for new projects. Nov 02 11:40:14 devstack cinder-volume[86549]: If you are already using Eventlet, we recommend migrating to a different Nov 02 11:40:14 devstack cinder-volume[86549]: framework. For more detail see Nov 02 11:40:14 devstack cinder-volume[86549]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 11:40:14 devstack cinder-volume[86549]: import eventlet # noqa Nov 02 11:40:16 devstack cinder-volume[86549]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 11:40:16 devstack cinder-volume[86549]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 11:40:16 devstack cinder-volume[86549]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 11:40:17 devstack cinder-volume[86549]: INFO dbcounter [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Registered counter for database cinder Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_db.sqlalchemy.engines [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG dbcounter [-] [86549] Writer thread running {{(pid=86549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 11:40:17 devstack cinder-volume[86549]: INFO cinder.rpc [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 11:40:17 devstack cinder-volume[86549]: INFO cinder.rpc [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_db.sqlalchemy.engines [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:40:17 devstack cinder-volume[86549]: INFO cinder.volume.manager [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Determined volume DB was empty at startup. Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG cinder.volume.manager [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86549) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 11:40:17 devstack cinder-volume[86549]: WARNING stevedore.named [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 11:40:17 devstack cinder-volume[86549]: WARNING castellan.key_manager [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 11:40:17 devstack cinder-volume[86549]: WARNING cinder.keymgr.conf_key_mgr [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 11:40:17 devstack cinder-volume[86549]: INFO cinder.volume.manager [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_db.sqlalchemy.engines [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:40:17 devstack cinder-volume[86549]: INFO oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Starting 1 workers Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Started child 86846 {{(pid=86549) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Full set of CONF: {{(pid=86549) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] ******************************************************************************** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] Configuration options gathered from: {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] ================================================================================ {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] allow_availability_zone_fallback = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86846]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] allow_compression_on_image_upload = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] allowed_direct_url_schemes = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] api_rate_limit = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] auth_strategy = keystone {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_availability_zone = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_host = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_stats_polling_interval = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backup_api_class = cinder.backup.api.API {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backup_name_template = backup-%s {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backup_use_same_host = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backup_use_temp_snapshot = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] chap_password = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] chap_username = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_internal_tenant_project_id = 53c4482585274017b3939df0b80ae0b9 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_internal_tenant_user_id = aa121bc5f84a49979d2ff880a3ee5fb7 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cluster = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] compression_format = gzip {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] compute_api_class = cinder.compute.nova.API {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] config_dir = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] config_source = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] control_exchange = openstack {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] debug = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] default_availability_zone = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] default_group_type = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] default_volume_type = QuobyteHD {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] disk_geometry = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] driver_client_cert = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] driver_client_cert_key = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] driver_data_namespace = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] driver_ssl_cert_path = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] driver_ssl_cert_verify = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] driver_use_ssl = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] enable_new_services = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] enable_unsupported_driver = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] enabled_backends = ['QuobyteHD'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] enforce_multipath_for_image_xfer = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] filter_function = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_api_insecure = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_api_servers = ['http://192.168.122.221/image'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_api_ssl_compression = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_ca_certificates_file = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_catalog_info = image:glance:publicURL {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_num_retries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance_request_timeout = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] goodness_function = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] graceful_shutdown_timeout = 5 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] group_api_class = cinder.group.api.API {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] host = devstack {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_compress_on_upload = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_conversion_address_space_limit = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_conversion_cpu_limit = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_conversion_disable = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_introspection_address_space_limit = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_introspection_cpu_limit = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_upload_use_cinder_backend = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_upload_use_internal_tenant = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_volume_cache_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_volume_cache_max_count = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] image_volume_cache_max_size_gb = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] init_host_max_objects_retrieval = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] instance_format = [instance: %(uuid)s] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] iscsi_target_flags = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] iscsi_write_cache = on {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] iser_helper = tgtadm {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] iser_ip_address = 192.168.122.221 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] iser_port = 3260 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_color = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_config_append = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86846) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_dir = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_file = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_options = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_rotate_interval = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_rotate_interval_type = days {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] log_rotation_type = none {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] max_age = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] max_logfile_count = 30 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] max_logfile_size_mb = 200 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] max_over_subscription_ratio = 20.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] message_reap_interval = 86400 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] message_ttl = 2592000 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] migration_create_volume_timeout_secs = 300 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] monkey_patch = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] monkey_patch_modules = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] my_ip = 192.168.122.221 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] no_snapshot_gb_quota = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] num_iser_scan_tries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] num_shell_tries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] num_volume_device_scan_tries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] nvmeof_conn_info_version = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] nvmet_ns_id = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] nvmet_port_id = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] osapi_max_limit = 1000 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] osapi_volume_ext_list = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] osapi_volume_listen_port = 8776 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] osapi_volume_use_ssl = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] osapi_volume_workers = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] per_volume_size_limit = -1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] periodic_fuzzy_delay = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] periodic_interval = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] public_endpoint = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] publish_errors = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] quota_backup_gigabytes = 1000 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] quota_backups = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] quota_gigabytes = 1000 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] quota_groups = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] quota_snapshots = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] quota_volumes = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] rate_limit_burst = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] rate_limit_except_level = CRITICAL {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] rate_limit_interval = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] reinit_driver_count = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] replication_device = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] report_discard_supported = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] report_interval = 120 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] reservation_clean_interval = 86400 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] reservation_expire = 86400 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] reserved_image_namespaces = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] reserved_percentage = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] rpc_response_timeout = 120 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] run_external_periodic_tasks = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] scst_target_driver = iscsi {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] scst_target_iqn_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_down_time = 720 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] shell_completion = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] snapshot_name_template = snapshot-%s {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] split_loggers = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] state_path = /opt/stack/data/cinder {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] storage_availability_zone = nova {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] storage_protocol = iSCSI {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] syslog_log_facility = LOG_USER {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] target_helper = lioadm {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] target_ip_address = 192.168.122.221 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] target_port = 3260 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] target_protocol = iscsi {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] target_secondary_ip_addresses = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] trace_flags = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] transport_url = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] until_refresh = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] use_chap_auth = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] use_default_quota_class = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] use_journal = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] use_json = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] use_multipath_for_image_xfer = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] use_stderr = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] use_syslog = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86846) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 11:40:17 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 11:40:17 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] verify_glance_signatures = enabled {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_api_class = cinder.volume.api.API {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_backend_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_clear = zero {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_clear_ionice = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Running cmd (subprocess): mount.quobyte {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_clear_size = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_copy_bps_limit = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_dd_blocksize = 1M {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_name_template = volume-%s {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_service_inithost_offload = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volume_usage_audit_period = month {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] zoning_mode = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_concurrency.disable_process_locking = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.auth_section = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.auth_type = password {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.auth_version = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.cache = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.include_service_catalog = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.insecure = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.interface = public {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_password = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcache_username = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.region_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.service_type = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.221/identity {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.backend = dogpile.cache.null {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.backend_argument = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.backend_expiration_time = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.config_prefix = cache.oslo {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.debug_cache_backend = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.enable_retry_client = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.enable_socket_keepalive = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.expiration_time = 600 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.hashclient_retry_attempts = 2 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.memcache_dead_retry = 300 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.memcache_pool_maxsize = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.memcache_sasl_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.password = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.proxies = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.redis_db = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.redis_server = localhost:6379 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.retry_attempts = 2 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.retry_delay = 0.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.socket_keepalive_count = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.socket_keepalive_idle = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.socket_keepalive_interval = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.socket_timeout = 1.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.tls_allowed_ciphers = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.tls_cafile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.tls_certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.tls_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.tls_keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cache.username = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] coordination.backend_url = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.asyncio_connection = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.asyncio_slave_connection = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.backend = sqlalchemy {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.connection = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.connection_debug = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.connection_parameters = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.connection_recycle_time = 3600 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.connection_trace = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.db_inc_retry_interval = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.db_max_retries = 20 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.db_max_retry_interval = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.db_retry_interval = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.max_overflow = 50 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.max_pool_size = 5 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.max_retries = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.mysql_wsrep_sync_wait = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.pool_timeout = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.retry_interval = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.slave_connection = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.sqlite_synchronous = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.synchronous_reader = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] database.use_db_reconnect = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_tracing.insecure = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.connection_string = messaging:// {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.es_doc_type = notification {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.es_scroll_size = 10000 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.es_scroll_time = 2m {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.filter_error_trace = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.hmac_keys = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.sentinel_service_name = mymaster {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.socket_timeout = 0.1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.trace_requests = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler.trace_sqlalchemy = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler_jaeger.process_tags = {} {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler_jaeger.service_name_prefix = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] profiler_otlp.service_name_prefix = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.enforce_new_defaults = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.policy_default_rule = default {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.policy_file = policy.yaml {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] privsep_osbrick.group = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] privsep_osbrick.helper_command = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] privsep_osbrick.user = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_sys_admin.group = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_sys_admin.helper_command = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:40:17 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] cinder_sys_admin.user = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.auth_section = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.auth_type = password {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.cafile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.collect_timing = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.insecure = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.send_service_user_token = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.split_loggers = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.timeout = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.tls_ciphers = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] service_user.tls_min_version = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.auth_section = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.auth_type = password {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.collect_timing = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.insecure = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.region_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.split_loggers = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.timeout = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.tls_ciphers = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] glance.tls_min_version = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.backend_availability_zone = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.chap_password = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.chap_username = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.disk_geometry = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.driver_client_cert = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.driver_client_cert_key = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.driver_data_namespace = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.driver_use_ssl = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.extra_capabilities = {} {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.filter_function = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.goodness_function = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.iscsi_target_flags = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.iscsi_write_cache = on {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.iser_helper = tgtadm {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.iser_ip_address = 192.168.122.221 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.iser_port = 3260 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_host = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_login = admin {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_mount_options = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_password = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_private_key = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_share_path = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.num_shell_tries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.quobyte_volume_url = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.replication_device = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.report_discard_supported = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.reserved_percentage = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.target_helper = tgtadm {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.target_ip_address = 192.168.122.221 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.target_port = 3260 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.target_protocol = iscsi {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.trace_flags = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.unique_fqdn_network = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.use_chap_auth = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_backend_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_clear = zero {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_clear_ionice = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_clear_size = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_reports.file_event_handler = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_reports.log_dir = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.backend_availability_zone = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.backend_host = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.chap_password = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.chap_username = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.chiscsi_conf = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.disk_geometry = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.driver_client_cert = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.driver_data_namespace = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.driver_use_ssl = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.extra_capabilities = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.filter_function = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.goodness_function = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.iser_helper = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.iser_ip_address = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.iser_port = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.iser_target_prefix = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_host = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_login = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_mount_options = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_password = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_private_key = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_share_path = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_ssh_port = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.num_shell_tries = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.nvmet_port_id = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.replication_device = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.report_discard_supported = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.reserved_percentage = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.scst_target_driver = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.storage_protocol = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.target_helper = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.target_ip_address = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.target_port = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.target_prefix = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.target_protocol = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.trace_flags = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.use_chap_auth = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_clear = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_clear_size = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] QuobyteHD.volumes_dir = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.ssl = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_notifications.driver = [] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_notifications.retry = -1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] key_manager.fixed_key = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.barbican_api_version = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.barbican_endpoint = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.barbican_endpoint_type = public {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.barbican_region_name = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.cafile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.collect_timing = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.insecure = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.number_of_retries = 60 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.retry_delay = 1 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.send_service_user_token = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.split_loggers = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.timeout = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.tls_ciphers = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.tls_min_version = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.verify_ssl = True {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican.verify_ssl_path = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.auth_section = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.auth_type = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.cafile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.certfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.collect_timing = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.insecure = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.keyfile = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.split_loggers = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.timeout = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.tls_ciphers = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] barbican_service_user.tls_min_version = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.approle_role_id = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.approle_secret_id = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.auth_method = approle {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.auth_path = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.kv_mountpoint = secret {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.kv_path = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.kv_version = 2 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.namespace = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.root_token_id = **** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.ssl_ca_crt_file = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.timeout = 60.0 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.token_file = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.token_role = None {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.use_ssl = False {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 11:40:17 devstack cinder-volume[86549]: DEBUG oslo_service.backend._eventlet.service [None req-e51d88ed-2505-482f-ac96-e211baa6a95d None None] ******************************************************************************** {{(pid=86549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 11:40:18 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:18 devstack cinder-volume[86846]: INFO cinder.volume.driver [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.volume.driver [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8525581359863, 'free_capacity_gb': 1773.8525581359863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_db.sqlalchemy.engines [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writer thread running {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.db.api [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Building query based on filter {{(pid=86846) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86846) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:40:18 devstack cinder-volume[86846]: INFO cinder.keymgr.migration [None req-8fd3f711-8c7d-4d8b-808a-f5ec35e78c69 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 11:40:18 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:40:18 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:40:18 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:40:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Driver initialization completed successfully. Nov 02 11:40:18 devstack cinder-volume[86846]: INFO cinder.manager [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Initiating service 3 cleanup Nov 02 11:40:18 devstack cinder-volume[86846]: INFO cinder.manager [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Service 3 cleanup completed. Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.service [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Creating RPC server for service cinder-volume {{(pid=86846) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.service [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86846) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 11:40:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:40:18 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:40:18 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:40:18 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.235s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:40:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b58eac8f-ef38-4cd5-8299-57e930d83d54 None None] Driver post RPC initialization completed successfully. Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 6 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:40:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:40:27 devstack cinder-volume[86549]: DEBUG dbcounter [-] [86549] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:40:28 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:40:28 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:41:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:41:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:19 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:41:19 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:19 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.749s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:41:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:41:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 6 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:41:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:41:24 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:41:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Flow 'volume_create_manager' (4336b25f-c819-4cae-a631-6025ac354bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296bab89-bdb2-478a-8ace-b0693084a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296bab89-bdb2-478a-8ace-b0693084a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1476398107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040dab8d-8e6e-48dd-be09-c48da4bb339a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295f32ff8ab04bb48d0f79d5b5566f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:24Z,use_quota=True,user_id='aa0fcd846da441bdb230ba3418a0cf21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a107d3e-cda1-4ee6-93d7-aedc5c2f076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a107d3e-cda1-4ee6-93d7-aedc5c2f076d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1e6645-f9a8-43c6-9023-f83680e2df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1e6645-f9a8-43c6-9023-f83680e2df7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040dab8d-8e6e-48dd-be09-c48da4bb339a', 'volume_name': 'volume-040dab8d-8e6e-48dd-be09-c48da4bb339a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d8719e-579f-4aaf-a704-c57d7ed5c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d8719e-579f-4aaf-a704-c57d7ed5c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb5aa9b-9f32-457b-8196-24eeb0a3a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Volume 040dab8d-8e6e-48dd-be09-c48da4bb339a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040dab8d-8e6e-48dd-be09-c48da4bb339a', 'volume_size': 1} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1476398107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040dab8d-8e6e-48dd-be09-c48da4bb339a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295f32ff8ab04bb48d0f79d5b5566f6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:24Z,use_quota=True,user_id='aa0fcd846da441bdb230ba3418a0cf21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Creating volume 040dab8d-8e6e-48dd-be09-c48da4bb339a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:41:25 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:41:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:25 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a 1073741824 Nov 02 11:41:25 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:26 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a 1073741824" returned: 0 in 1.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:26 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a Nov 02 11:41:26 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:27 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a" returned: 0 in 0.550s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:41:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb5aa9b-9f32-457b-8196-24eeb0a3a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040dab8d-8e6e-48dd-be09-c48da4bb339a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc8958b-0b18-409b-b92f-79e280434a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Volume volume-040dab8d-8e6e-48dd-be09-c48da4bb339a (040dab8d-8e6e-48dd-be09-c48da4bb339a): created successfully Nov 02 11:41:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc8958b-0b18-409b-b92f-79e280434a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Flow 'volume_create_manager' (4336b25f-c819-4cae-a631-6025ac354bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a2d6b3ac-3b08-411c-9a2d-2a33b07b7d90 tempest-DeleteServersTestJSON-887657877 None] Created volume successfully. Nov 02 11:41:35 devstack cinder-volume[86846]: WARNING py.warnings [req-a5b1f834-273a-43d2-863e-7b3a3b3133b3 req-f0f91bbe-ba70-4828-95d2-9788b9599afb tempest-DeleteServersTestJSON-887657877 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 02 11:41:35 devstack cinder-volume[86846]: .first() Nov 02 11:41:35 devstack cinder-volume[86846]: Nov 02 11:41:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a5b1f834-273a-43d2-863e-7b3a3b3133b3 req-f0f91bbe-ba70-4828-95d2-9788b9599afb tempest-DeleteServersTestJSON-887657877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a5b1f834-273a-43d2-863e-7b3a3b3133b3 req-f0f91bbe-ba70-4828-95d2-9788b9599afb tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a5b1f834-273a-43d2-863e-7b3a3b3133b3 req-f0f91bbe-ba70-4828-95d2-9788b9599afb tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-a5b1f834-273a-43d2-863e-7b3a3b3133b3 req-f0f91bbe-ba70-4828-95d2-9788b9599afb tempest-DeleteServersTestJSON-887657877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-040dab8d-8e6e-48dd-be09-c48da4bb339a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f70daec-f0cb-4cb1-b0ca-76670610dfb5', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:41:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-a5b1f834-273a-43d2-863e-7b3a3b3133b3 req-f0f91bbe-ba70-4828-95d2-9788b9599afb tempest-DeleteServersTestJSON-887657877 None] attachment_update completed successfully. Nov 02 11:41:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-2fe87899-8315-43b3-a87f-5a55a2fa3a45 req-a8e155b9-13c5-4ec2-b34c-78a1bf6135a7 tempest-DeleteServersTestJSON-887657877 None] Terminate volume connection completed successfully. Nov 02 11:41:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-2fe87899-8315-43b3-a87f-5a55a2fa3a45 req-a8e155b9-13c5-4ec2-b34c-78a1bf6135a7 tempest-DeleteServersTestJSON-887657877 None] Deleting attachment 1f70daec-f0cb-4cb1-b0ca-76670610dfb5. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Flow 'volume_create_manager' (9e55e50a-ff8c-44a8-bfcd-7114335f0e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147ae439-37a9-4d37-90a3-b6cf8321d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147ae439-37a9-4d37-90a3-b6cf8321d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1435787682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c12fe6ce264d6a8738a474194af00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:45Z,use_quota=True,user_id='c1a7b7e69e4742d185c3a136270bd0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c5c48d-0836-4457-b675-4c28163b23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c5c48d-0836-4457-b675-4c28163b23a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b2662-ab90-47fb-8009-99c7fcbc918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656b2662-ab90-47fb-8009-99c7fcbc918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77', 'volume_name': 'volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3428b5f-13f8-454d-a334-481f9d399749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3428b5f-13f8-454d-a334-481f9d399749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c007ae2-8d09-4fe4-892b-b285b4a2debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Volume 90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77', 'volume_size': 1} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1435787682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c12fe6ce264d6a8738a474194af00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:45Z,use_quota=True,user_id='c1a7b7e69e4742d185c3a136270bd0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Creating volume 90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:41:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:41:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:44 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 1073741824 Nov 02 11:41:44 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Acquiring lock "cinder-040dab8d-8e6e-48dd-be09-c48da4bb339a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Lock "cinder-040dab8d-8e6e-48dd-be09-c48da4bb339a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:41:45 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 1073741824" returned: 0 in 0.505s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Acquiring lock "cinder-quobyte-040dab8d-8e6e-48dd-be09-c48da4bb339a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Lock "cinder-quobyte-040dab8d-8e6e-48dd-be09-c48da4bb339a" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:41:45 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4wq8dx1g/privsep.sock'] Nov 02 11:41:45 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4wq8dx1g/privsep.sock Nov 02 11:41:45 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:45 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 Nov 02 11:41:45 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:45 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c007ae2-8d09-4fe4-892b-b285b4a2debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7382b380-bb59-4e09-ab6e-a9ea70c1d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Volume volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 (90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77): created successfully Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7382b380-bb59-4e09-ab6e-a9ea70c1d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Flow 'volume_create_manager' (9e55e50a-ff8c-44a8-bfcd-7114335f0e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-757c995c-837b-4cbd-975b-4d37ceb08720 tempest-ServersNegativeTestJSON-811251040 None] Created volume successfully. Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Flow 'volume_create_manager' (24bd8795-9629-460e-8cc8-93ee5ff2f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e0931d-b09f-4110-b00c-9bb92f9ed370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 11:41:46 devstack cinder-volume[86846]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e0931d-b09f-4110-b00c-9bb92f9ed370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-944447675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f045f552-8011-4803-b7cb-ebc491a2a515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42fb0313594441387faba1e6aa34877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:46Z,use_quota=True,user_id='d45f441df6544e978983689d269b307f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f3cbff-bb9a-4b5d-bc9f-10e810e9e00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f3cbff-bb9a-4b5d-bc9f-10e810e9e00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af22eb30-2d53-48d6-aa6a-5bf74877d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af22eb30-2d53-48d6-aa6a-5bf74877d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f045f552-8011-4803-b7cb-ebc491a2a515', 'volume_name': 'volume-f045f552-8011-4803-b7cb-ebc491a2a515', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e36446c-02d0-4ce8-a031-b0bd51a89a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e36446c-02d0-4ce8-a031-b0bd51a89a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d64463-bf4a-498c-84df-571853d0c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Volume f045f552-8011-4803-b7cb-ebc491a2a515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f045f552-8011-4803-b7cb-ebc491a2a515', 'volume_size': 1} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-944447675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f045f552-8011-4803-b7cb-ebc491a2a515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42fb0313594441387faba1e6aa34877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:46Z,use_quota=True,user_id='d45f441df6544e978983689d269b307f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Creating volume f045f552-8011-4803-b7cb-ebc491a2a515 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:41:46 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:46 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 1073741824 Nov 02 11:41:46 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:46 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:46 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Spawned new privsep daemon via rootwrap Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Accepted privsep connection to /tmp/tmp4wq8dx1g/privsep.sock {{(pid=86846) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 11:41:46 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 11:41:46 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 11:41:46 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 11:41:46 devstack cinder-volume[86846]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88701 Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4635462b-e681-4014-8297-222994df6082]: (2,) {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b011e55-038d-4bb8-889e-0951139907ae]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:41:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:46 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a Nov 02 11:41:46 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:47 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 1073741824" returned: 0 in 0.685s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:47 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 Nov 02 11:41:47 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:47 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a" returned: 0 in 0.652s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:47 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a Nov 02 11:41:47 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:47 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-040dab8d-8e6e-48dd-be09-c48da4bb339a" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Lock "cinder-quobyte-040dab8d-8e6e-48dd-be09-c48da4bb339a" released by "delete_volume" :: held 2.267s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:41:47 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515" returned: 0 in 0.436s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d64463-bf4a-498c-84df-571853d0c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f045f552-8011-4803-b7cb-ebc491a2a515', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd58f0c5-05f0-4f0a-8be5-f01c20ec6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:47 devstack cinder-volume[86846]: WARNING cinder.quota [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:41:47 devstack cinder-volume[86846]: WARNING cinder.quota [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:41:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Volume volume-f045f552-8011-4803-b7cb-ebc491a2a515 (f045f552-8011-4803-b7cb-ebc491a2a515): created successfully Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd58f0c5-05f0-4f0a-8be5-f01c20ec6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Flow 'volume_create_manager' (24bd8795-9629-460e-8cc8-93ee5ff2f916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-47bd8c39-ecf6-4598-9888-5ee94b4bdf90 tempest-AttachVolumeShelveTestJSON-1845072715 None] Created volume successfully. Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Created reservations ['24092b08-012c-4675-88c1-23301f815184', 'bde63512-b89f-4d1b-91f5-f45a729459e3', 'ff6ea508-e0d6-4bcc-b72d-66031e74fcf4', '7396a215-d0c4-4734-82cb-7b51e566919d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:47 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:41:47 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:48 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:41:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Deleted volume successfully. Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-804c7e3b-11f8-4d44-95e6-70c741e816cf tempest-DeleteServersTestJSON-887657877 None] Lock "cinder-040dab8d-8e6e-48dd-be09-c48da4bb339a-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Flow 'volume_create_manager' (6039f27d-23ef-4973-b725-7551bfe7b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aaae6a-47f5-4b83-9646-927211ca9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27aaae6a-47f5-4b83-9646-927211ca9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-697453190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd51257-d52d-482b-88d4-92b3f0d20887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c12fe6ce264d6a8738a474194af00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:49Z,use_quota=True,user_id='c1a7b7e69e4742d185c3a136270bd0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e968cb9-3169-4fa0-a12f-41046c360c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e968cb9-3169-4fa0-a12f-41046c360c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614b7daa-678d-4854-97da-f5bbeab87d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614b7daa-678d-4854-97da-f5bbeab87d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd51257-d52d-482b-88d4-92b3f0d20887', 'volume_name': 'volume-ddd51257-d52d-482b-88d4-92b3f0d20887', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd7ff64-3338-4e17-a692-52e18b78dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd7ff64-3338-4e17-a692-52e18b78dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3ed47a-b165-487e-a8c3-233f5b3e00f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Volume ddd51257-d52d-482b-88d4-92b3f0d20887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd51257-d52d-482b-88d4-92b3f0d20887', 'volume_size': 1} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-697453190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd51257-d52d-482b-88d4-92b3f0d20887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c12fe6ce264d6a8738a474194af00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:41:49Z,use_quota=True,user_id='c1a7b7e69e4742d185c3a136270bd0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Creating volume ddd51257-d52d-482b-88d4-92b3f0d20887 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:41:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:41:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:48 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 1073741824 Nov 02 11:41:48 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:49 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 1073741824" returned: 0 in 0.594s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:49 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 Nov 02 11:41:49 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:49 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887" returned: 0 in 0.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:41:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3ed47a-b165-487e-a8c3-233f5b3e00f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd51257-d52d-482b-88d4-92b3f0d20887', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fb4085-a85b-446f-9aa5-0a2a919446a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:41:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Volume volume-ddd51257-d52d-482b-88d4-92b3f0d20887 (ddd51257-d52d-482b-88d4-92b3f0d20887): created successfully Nov 02 11:41:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fb4085-a85b-446f-9aa5-0a2a919446a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:41:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Flow 'volume_create_manager' (6039f27d-23ef-4973-b725-7551bfe7b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:41:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0ba1570d-3c02-4d55-82ce-ce77dd38a1b0 tempest-ServersNegativeTestJSON-811251040 None] Created volume successfully. Nov 02 11:41:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "cinder-ddd51257-d52d-482b-88d4-92b3f0d20887-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:41:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-ddd51257-d52d-482b-88d4-92b3f0d20887-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:41:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "cinder-quobyte-ddd51257-d52d-482b-88d4-92b3f0d20887" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:41:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-quobyte-ddd51257-d52d-482b-88d4-92b3f0d20887" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:41:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb550d2a-e06a-42ba-bca7-e7e27fcd3e1c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:41:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:51 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 Nov 02 11:41:51 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:52 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887" returned: 0 in 0.518s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:52 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887 Nov 02 11:41:52 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:52 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddd51257-d52d-482b-88d4-92b3f0d20887" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-quobyte-ddd51257-d52d-482b-88d4-92b3f0d20887" released by "delete_volume" :: held 1.058s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Created reservations ['292a8686-6318-4d3f-9645-44bada5334b8', '982c5ac9-cce5-40c9-9015-083a1f62980c', '541c20b0-0b0c-472f-9744-02a2c049933c', 'd23d9ce2-7e86-49be-92e5-ee2e4276f959'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:52 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:41:52 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:53 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:53 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:41:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Deleted volume successfully. Nov 02 11:41:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-779d4b48-9ee2-49bf-9c45-e138993db5c8 tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-ddd51257-d52d-482b-88d4-92b3f0d20887-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:41:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "cinder-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:41:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:41:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "cinder-quobyte-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:41:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-quobyte-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:41:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a27f9a-f45e-4a0c-80dd-67641a7fd96f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:41:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:54 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 Nov 02 11:41:54 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:54 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77" returned: 0 in 0.558s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:54 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77 Nov 02 11:41:54 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:55 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77" returned: 0 in 0.474s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-quobyte-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77" released by "delete_volume" :: held 1.119s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Created reservations ['184fc6d7-17bb-48c5-80ae-b0e2b3166441', '56761f3f-45da-4e2a-82d3-2f06d3081d4a', '74e621cc-3b3b-4992-b8c5-19b11da572d7', 'bc58b96e-2f6b-4eb6-a745-3e13a5eff629'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:41:55 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:41:55 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:41:55 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:41:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Deleted volume successfully. Nov 02 11:41:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3857928f-fc50-4c35-8a77-35af6739624e tempest-ServersNegativeTestJSON-811251040 None] Lock "cinder-90ab8e6d-cf6a-4ed0-906b-b8c4bb4fcb77-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:42:05 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=32,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:42:05 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=41,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:42:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-7a290a40-bf8a-428e-891e-d45cf32af396 req-a4cdee9c-636a-4d28-85fa-50b99033d277 tempest-AttachVolumeShelveTestJSON-1845072715 None] No connector for attachment 46f126c7-8a6f-4f7c-b73e-f22982c3dd2b; skipping storage backend terminate_connection call. {{(pid=86846) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 11:42:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-7a290a40-bf8a-428e-891e-d45cf32af396 req-a4cdee9c-636a-4d28-85fa-50b99033d277 tempest-AttachVolumeShelveTestJSON-1845072715 None] Deleting attachment 46f126c7-8a6f-4f7c-b73e-f22982c3dd2b. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:42:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:42:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:42:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:42:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:42:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:42:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:42:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:42:18 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:42:18 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:42:19 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Nov 02 11:42:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:42:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:42:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:42:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 8 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:42:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:42:28 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:42:28 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Flow 'volume_create_manager' (448ab1fa-39b4-4fb8-8ab4-8159014e4f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8b3a50-69df-49e2-ad4e-3fe9c1c9647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8b3a50-69df-49e2-ad4e-3fe9c1c9647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-820676403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a410c2d1-2a5e-403c-a185-8f0740ee98f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6d928548c5f4d0199954ffc8ac84621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:42:37Z,use_quota=True,user_id='4cab9de7243f46098ffd9761f68d88ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0bf888-9e96-4d63-bcb3-959957d5c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0bf888-9e96-4d63-bcb3-959957d5c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21ef3e8-178e-4403-a8e7-66977e520f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21ef3e8-178e-4403-a8e7-66977e520f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a410c2d1-2a5e-403c-a185-8f0740ee98f4', 'volume_name': 'volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68687387-7f95-4ecb-bd5d-2dcd45f1f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68687387-7f95-4ecb-bd5d-2dcd45f1f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef02c93-a7a0-4141-bbff-456255d172bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:42:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Volume a410c2d1-2a5e-403c-a185-8f0740ee98f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4', 'volume_size': 1} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-820676403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a410c2d1-2a5e-403c-a185-8f0740ee98f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6d928548c5f4d0199954ffc8ac84621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:42:37Z,use_quota=True,user_id='4cab9de7243f46098ffd9761f68d88ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Creating volume a410c2d1-2a5e-403c-a185-8f0740ee98f4 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:42:37 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:42:37 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 1073741824 Nov 02 11:42:37 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:42:37 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Nov 02 11:42:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 1073741824" returned: 0 in 0.572s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:42:38 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 Nov 02 11:42:38 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:42:38 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef02c93-a7a0-4141-bbff-456255d172bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1c2e9d-ca9f-4425-9a36-c30ce29e244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:42:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Volume volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 (a410c2d1-2a5e-403c-a185-8f0740ee98f4): created successfully Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1c2e9d-ca9f-4425-9a36-c30ce29e244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:42:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Flow 'volume_create_manager' (448ab1fa-39b4-4fb8-8ab4-8159014e4f8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:42:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4c7e46ab-4cbd-4e36-a1e4-4894e91d5604 tempest-TaggedAttachmentsTest-190826753 None] Created volume successfully. Nov 02 11:42:48 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:42:48 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Flow 'volume_create_manager' (4447c6ff-e481-4fed-9978-ae4519f48bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6a55b9-59db-494a-8dfb-4feda6f78b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6a55b9-59db-494a-8dfb-4feda6f78b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2016057735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ef24b9-4232-412b-a7e5-d9f9f932c650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d153f4c0874b413bafeac1bfffab1819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:43:02Z,use_quota=True,user_id='e423f31cad6d4bfa870bbadb16b443dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b50ca25-4ef9-48e5-a2ed-9e8cd19b395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b50ca25-4ef9-48e5-a2ed-9e8cd19b395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26afff21-668b-422c-b477-a4034a790ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26afff21-668b-422c-b477-a4034a790ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ef24b9-4232-412b-a7e5-d9f9f932c650', 'volume_name': 'volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a246981-1d16-4d8a-b262-a1a7b65b66ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a246981-1d16-4d8a-b262-a1a7b65b66ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d8ca3f-9275-44ec-8f3b-4c8f42bd3586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Volume c6ef24b9-4232-412b-a7e5-d9f9f932c650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650', 'volume_size': 1} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2016057735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ef24b9-4232-412b-a7e5-d9f9f932c650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d153f4c0874b413bafeac1bfffab1819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:43:02Z,use_quota=True,user_id='e423f31cad6d4bfa870bbadb16b443dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Creating volume c6ef24b9-4232-412b-a7e5-d9f9f932c650 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:43:02 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:43:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:02 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 1073741824 Nov 02 11:43:02 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:03 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 1073741824" returned: 0 in 0.613s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:03 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 Nov 02 11:43:03 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:03 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650" returned: 0 in 0.418s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d8ca3f-9275-44ec-8f3b-4c8f42bd3586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e45401-475e-4cc6-b926-f4a6d0c09ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Volume volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 (c6ef24b9-4232-412b-a7e5-d9f9f932c650): created successfully Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e45401-475e-4cc6-b926-f4a6d0c09ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Flow 'volume_create_manager' (4447c6ff-e481-4fed-9978-ae4519f48bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:43:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a9171db6-cd3e-4775-aba1-efedd38083d7 tempest-VolumesAdminNegativeTest-1862913585 None] Created volume successfully. Nov 02 11:43:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Acquiring lock "cinder-c6ef24b9-4232-412b-a7e5-d9f9f932c650-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:43:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Lock "cinder-c6ef24b9-4232-412b-a7e5-d9f9f932c650-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:43:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Acquiring lock "cinder-quobyte-c6ef24b9-4232-412b-a7e5-d9f9f932c650" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:43:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Lock "cinder-quobyte-c6ef24b9-4232-412b-a7e5-d9f9f932c650" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:43:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1455fffe-3498-4b6f-9b5f-b734a5f63a4e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:43:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:05 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 Nov 02 11:43:05 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:06 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650" returned: 0 in 0.746s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:06 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650 Nov 02 11:43:06 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:06 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6ef24b9-4232-412b-a7e5-d9f9f932c650" returned: 0 in 0.454s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Lock "cinder-quobyte-c6ef24b9-4232-412b-a7e5-d9f9f932c650" released by "delete_volume" :: held 1.270s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Created reservations ['cdd7c88d-6905-4c85-b34f-1946eb3ed4f1', '426b6c35-cd5b-49dd-9c9f-a6fff1fe228c', '4faf225d-bb30-4269-bce2-e9c1d34e641e', 'b198c74e-e8ea-4159-8986-f344d9844c6d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:06 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:43:06 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:07 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:07 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:43:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Deleted volume successfully. Nov 02 11:43:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ad256343-e8bb-4ed6-9848-01bd06bf99cf tempest-VolumesAdminNegativeTest-1862913585 None] Lock "cinder-c6ef24b9-4232-412b-a7e5-d9f9f932c650-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:43:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Acquiring lock "cinder-f045f552-8011-4803-b7cb-ebc491a2a515-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:43:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "cinder-f045f552-8011-4803-b7cb-ebc491a2a515-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:43:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Acquiring lock "cinder-quobyte-f045f552-8011-4803-b7cb-ebc491a2a515" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:43:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "cinder-quobyte-f045f552-8011-4803-b7cb-ebc491a2a515" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:43:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[443046c4-cf77-4688-a39d-404eaf655505]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:43:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:16 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 Nov 02 11:43:16 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:17 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515" returned: 0 in 0.577s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:17 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515 Nov 02 11:43:17 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:17 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f045f552-8011-4803-b7cb-ebc491a2a515" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "cinder-quobyte-f045f552-8011-4803-b7cb-ebc491a2a515" released by "delete_volume" :: held 1.001s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Created reservations ['e9938937-ee22-49fb-9698-a96a5620640b', 'f749e14a-9919-4e8e-9176-f781c13eacf7', '5cd2a752-dad6-4937-b0c6-e61491740577', '0e0159c7-70f3-4f61-98fe-febe6b84d9bb'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:17 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:43:17 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:18 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.299s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:43:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Deleted volume successfully. Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14a35cce-289c-4184-9476-9b544f78335c tempest-AttachVolumeShelveTestJSON-1845072715 None] Lock "cinder-f045f552-8011-4803-b7cb-ebc491a2a515-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:18 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:43:18 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:19 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Flow 'volume_create_manager' (17c515b8-cf7e-49b9-9622-cb5e41147b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb4a40c-1c7d-44e1-ac3c-f2d50f915c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb4a40c-1c7d-44e1-ac3c-f2d50f915c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-784029742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6149854-4866-409b-a6e6-23c5be9244ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9471528dc52342c482831b4f3469d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:43:24Z,use_quota=True,user_id='7827a13a4af9470cb0c3ae2bfc7f4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f79059-07be-4b6c-ac29-7ad1c8555c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f79059-07be-4b6c-ac29-7ad1c8555c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabcd273-980a-4f63-b50a-92f1f5c73492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabcd273-980a-4f63-b50a-92f1f5c73492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6149854-4866-409b-a6e6-23c5be9244ed', 'volume_name': 'volume-c6149854-4866-409b-a6e6-23c5be9244ed', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e901cf0c-1916-4552-9f94-30b0f1903d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e901cf0c-1916-4552-9f94-30b0f1903d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7dcd3b-bdbe-403d-9444-16b16753fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Volume c6149854-4866-409b-a6e6-23c5be9244ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6149854-4866-409b-a6e6-23c5be9244ed', 'volume_size': 1} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-784029742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6149854-4866-409b-a6e6-23c5be9244ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9471528dc52342c482831b4f3469d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:43:24Z,use_quota=True,user_id='7827a13a4af9470cb0c3ae2bfc7f4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Creating volume c6149854-4866-409b-a6e6-23c5be9244ed {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:43:24 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:43:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:24 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed 1073741824 Nov 02 11:43:24 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:25 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed 1073741824" returned: 0 in 0.557s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:43:25 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed Nov 02 11:43:25 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:43:25 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed" returned: 0 in 0.250s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7dcd3b-bdbe-403d-9444-16b16753fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6149854-4866-409b-a6e6-23c5be9244ed', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f53ef-d48e-428e-9a8e-9629e98a1d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:43:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Volume volume-c6149854-4866-409b-a6e6-23c5be9244ed (c6149854-4866-409b-a6e6-23c5be9244ed): created successfully Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f53ef-d48e-428e-9a8e-9629e98a1d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:43:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Flow 'volume_create_manager' (17c515b8-cf7e-49b9-9622-cb5e41147b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:43:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-36286367-69b9-4d79-9463-fdf3d711941f tempest-AttachVolumeTestJSON-1453177904 None] Created volume successfully. Nov 02 11:43:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-d964915d-9b02-44ab-9f55-ab8a2a208fbd req-f3ce9838-9f71-46ad-88f9-57483abf8ea7 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-d964915d-9b02-44ab-9f55-ab8a2a208fbd req-f3ce9838-9f71-46ad-88f9-57483abf8ea7 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-d964915d-9b02-44ab-9f55-ab8a2a208fbd req-f3ce9838-9f71-46ad-88f9-57483abf8ea7 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-d964915d-9b02-44ab-9f55-ab8a2a208fbd req-f3ce9838-9f71-46ad-88f9-57483abf8ea7 tempest-AttachVolumeTestJSON-1453177904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-c6149854-4866-409b-a6e6-23c5be9244ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b50d097b-d3b0-4e03-903c-c0d45c7498d9', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:43:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-d964915d-9b02-44ab-9f55-ab8a2a208fbd req-f3ce9838-9f71-46ad-88f9-57483abf8ea7 tempest-AttachVolumeTestJSON-1453177904 None] attachment_update completed successfully. Nov 02 11:43:37 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:43:37 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:43:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-2a50b701-269f-4121-948f-38772a9b74d1 req-001773ea-17dc-4123-842e-539532f741cd tempest-TaggedAttachmentsTest-190826753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:43:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-2a50b701-269f-4121-948f-38772a9b74d1 req-001773ea-17dc-4123-842e-539532f741cd tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:43:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-2a50b701-269f-4121-948f-38772a9b74d1 req-001773ea-17dc-4123-842e-539532f741cd tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:43:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-2a50b701-269f-4121-948f-38772a9b74d1 req-001773ea-17dc-4123-842e-539532f741cd tempest-TaggedAttachmentsTest-190826753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '733f7d53-2cc3-4b32-b01f-f182bf87fd22', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:43:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-2a50b701-269f-4121-948f-38772a9b74d1 req-001773ea-17dc-4123-842e-539532f741cd tempest-TaggedAttachmentsTest-190826753 None] attachment_update completed successfully. Nov 02 11:43:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-c455cde3-f208-4a01-86ea-57341f261713 req-de77b819-f045-4107-90de-df72d055b7a6 tempest-TaggedAttachmentsTest-190826753 None] Terminate volume connection completed successfully. Nov 02 11:43:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-c455cde3-f208-4a01-86ea-57341f261713 req-de77b819-f045-4107-90de-df72d055b7a6 tempest-TaggedAttachmentsTest-190826753 None] Deleting attachment 733f7d53-2cc3-4b32-b01f-f182bf87fd22. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:44:04 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=7 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:44:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-b85d864d-eb74-4956-92d7-47930c1d2910 req-1aae007a-e4d7-47e9-9c47-2c834573aa40 tempest-AttachVolumeTestJSON-1453177904 None] Terminate volume connection completed successfully. Nov 02 11:44:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-b85d864d-eb74-4956-92d7-47930c1d2910 req-1aae007a-e4d7-47e9-9c47-2c834573aa40 tempest-AttachVolumeTestJSON-1453177904 None] Deleting attachment b50d097b-d3b0-4e03-903c-c0d45c7498d9. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:44:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Acquiring lock "cinder-a410c2d1-2a5e-403c-a185-8f0740ee98f4-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:44:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Lock "cinder-a410c2d1-2a5e-403c-a185-8f0740ee98f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:44:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Acquiring lock "cinder-quobyte-a410c2d1-2a5e-403c-a185-8f0740ee98f4" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:44:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Lock "cinder-quobyte-a410c2d1-2a5e-403c-a185-8f0740ee98f4" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:44:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb9c1e4-a3b2-485c-9bcf-549818d4cd4f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:44:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:44:15 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 Nov 02 11:44:15 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:44:16 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4" returned: 0 in 0.523s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:44:16 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4 Nov 02 11:44:16 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:44:16 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a410c2d1-2a5e-403c-a185-8f0740ee98f4" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Lock "cinder-quobyte-a410c2d1-2a5e-403c-a185-8f0740ee98f4" released by "delete_volume" :: held 0.926s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Created reservations ['82c26a7f-a5c6-4915-ae18-42a4b6bbc7c6', 'c659e0af-3f4f-42b1-9357-be074f8695c3', '36d802b6-56c0-4a77-88d9-a03c6641d2eb', 'd3da39fe-7b34-462d-86e2-55e78486167d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:44:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:44:16 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:44:16 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:44:17 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Nov 02 11:44:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:44:17 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:44:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Deleted volume successfully. Nov 02 11:44:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-45dd9627-b83d-4ffb-a3cc-1b5d59ffd710 tempest-TaggedAttachmentsTest-190826753 None] Lock "cinder-a410c2d1-2a5e-403c-a185-8f0740ee98f4-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Flow 'volume_create_manager' (9f675063-6821-4ce3-8e04-f56e2b054685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bd90b6-937c-4835-9a61-33a673eb18b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bd90b6-937c-4835-9a61-33a673eb18b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-530274552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7363a93-bd6b-4f76-9b24-f0d4c57ab198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28bc9d5b5324c33874e9b0bb580e62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:44:18Z,use_quota=True,user_id='6670090b4c394871921fc41b2b2c43e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cdfa8-ef49-4c23-9711-e9359b99af0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508cdfa8-ef49-4c23-9711-e9359b99af0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1365e4d-907a-4ba2-a6b8-53d93738c362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1365e4d-907a-4ba2-a6b8-53d93738c362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7363a93-bd6b-4f76-9b24-f0d4c57ab198', 'volume_name': 'volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dab9e90-c394-4e6d-832c-faf9eb48539f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dab9e90-c394-4e6d-832c-faf9eb48539f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ab3fd6-d9e6-4a85-8d11-b345416e57bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Volume c7363a93-bd6b-4f76-9b24-f0d4c57ab198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198', 'volume_size': 1} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-530274552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7363a93-bd6b-4f76-9b24-f0d4c57ab198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28bc9d5b5324c33874e9b0bb580e62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:44:18Z,use_quota=True,user_id='6670090b4c394871921fc41b2b2c43e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Creating volume c7363a93-bd6b-4f76-9b24-f0d4c57ab198 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:44:18 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:44:18 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 1073741824 Nov 02 11:44:18 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:44:18 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 1073741824" returned: 0 in 0.580s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 8 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:44:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:44:18 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 Nov 02 11:44:18 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:44:19 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Nov 02 11:44:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:44:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:44:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:44:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ab3fd6-d9e6-4a85-8d11-b345416e57bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63847560-d00d-4fef-8cac-87e882eb11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:19 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Volume volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 (c7363a93-bd6b-4f76-9b24-f0d4c57ab198): created successfully Nov 02 11:44:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63847560-d00d-4fef-8cac-87e882eb11ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Flow 'volume_create_manager' (9f675063-6821-4ce3-8e04-f56e2b054685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:44:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-433c56a4-38dd-45dd-8098-274d48b65ad5 tempest-AttachVolumeNegativeTest-1244714756 None] Created volume successfully. Nov 02 11:44:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-2346f2ad-0fb3-4d9f-9db8-826532e77307 req-afcf2a6d-1338-4e05-b162-8fb17338fc46 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:44:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-2346f2ad-0fb3-4d9f-9db8-826532e77307 req-afcf2a6d-1338-4e05-b162-8fb17338fc46 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:44:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-2346f2ad-0fb3-4d9f-9db8-826532e77307 req-afcf2a6d-1338-4e05-b162-8fb17338fc46 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:44:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-2346f2ad-0fb3-4d9f-9db8-826532e77307 req-afcf2a6d-1338-4e05-b162-8fb17338fc46 tempest-AttachVolumeNegativeTest-1244714756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0412557b-9c7c-48cc-b9ac-1ff86c1dd698', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:44:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-2346f2ad-0fb3-4d9f-9db8-826532e77307 req-afcf2a6d-1338-4e05-b162-8fb17338fc46 tempest-AttachVolumeNegativeTest-1244714756 None] attachment_update completed successfully. Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=17,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=25,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Flow 'volume_create_manager' (0dbcdb90-aad8-4cc7-a51c-9d103dd8065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98425fb5-4ca0-474f-80c4-51f575fa0f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98425fb5-4ca0-474f-80c4-51f575fa0f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2090102453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1680b0-ba94-4a52-9049-665d60eb79d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f684da12825c4dab95cc04623085c4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:44:31Z,use_quota=True,user_id='2590b3c6bd154cab825f9df9a2645ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6060505f-2cd3-451d-9c3a-6bced788fa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6060505f-2cd3-451d-9c3a-6bced788fa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6c55af-8f76-4822-a658-61068387886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6c55af-8f76-4822-a658-61068387886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e1680b0-ba94-4a52-9049-665d60eb79d3', 'volume_name': 'volume-3e1680b0-ba94-4a52-9049-665d60eb79d3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74a684c-e432-4763-b20e-c6ddd77a2d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74a684c-e432-4763-b20e-c6ddd77a2d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472eee48-3800-4937-a1db-77d32ad8f3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Volume 3e1680b0-ba94-4a52-9049-665d60eb79d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e1680b0-ba94-4a52-9049-665d60eb79d3', 'volume_size': 1} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2090102453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1680b0-ba94-4a52-9049-665d60eb79d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f684da12825c4dab95cc04623085c4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:44:31Z,use_quota=True,user_id='2590b3c6bd154cab825f9df9a2645ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Creating volume 3e1680b0-ba94-4a52-9049-665d60eb79d3 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:44:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:44:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:44:31 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 1073741824 Nov 02 11:44:31 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:44:32 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 1073741824" returned: 0 in 0.851s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:44:32 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 Nov 02 11:44:32 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:44:32 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472eee48-3800-4937-a1db-77d32ad8f3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1680b0-ba94-4a52-9049-665d60eb79d3', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f04c4df-0941-461a-8f53-ab89674ff2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:44:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Volume volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 (3e1680b0-ba94-4a52-9049-665d60eb79d3): created successfully Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f04c4df-0941-461a-8f53-ab89674ff2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:44:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Flow 'volume_create_manager' (0dbcdb90-aad8-4cc7-a51c-9d103dd8065d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:44:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4c679d75-583e-4158-96f0-508d4b03ab9b tempest-ServerActionsTestOtherA-217023053 None] Created volume successfully. Nov 02 11:44:43 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:44:43 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:45:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-ce962970-b44e-46ef-9e5b-6181e99c1bc7 req-b58d5b69-41e2-424d-8316-e6da554fa68d tempest-AttachVolumeNegativeTest-1244714756 None] Terminate volume connection completed successfully. Nov 02 11:45:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-ce962970-b44e-46ef-9e5b-6181e99c1bc7 req-b58d5b69-41e2-424d-8316-e6da554fa68d tempest-AttachVolumeNegativeTest-1244714756 None] Deleting attachment 0412557b-9c7c-48cc-b9ac-1ff86c1dd698. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Flow 'volume_create_manager' (7e168bc7-d488-46a3-9f51-2886cf9eb489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32d72cc-d4cd-4ddd-b316-675a51ad5708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32d72cc-d4cd-4ddd-b316-675a51ad5708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-275351124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f20ba92-2269-426c-839d-5343f05301fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c65e1ec71548b786d728993543a662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:18Z,use_quota=True,user_id='94be5525335c4c6dab74b84c6d1ee67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1d470f-a301-4c2f-955c-31b046071a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1d470f-a301-4c2f-955c-31b046071a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79adce1a-a507-44c4-8a78-fbab384ac622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79adce1a-a507-44c4-8a78-fbab384ac622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f20ba92-2269-426c-839d-5343f05301fc', 'volume_name': 'volume-5f20ba92-2269-426c-839d-5343f05301fc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c9dd2c-8110-4562-9d41-609b6b2e3c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c9dd2c-8110-4562-9d41-609b6b2e3c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2861d0c-0880-450a-911e-7d67f80c33e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:17 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Volume 5f20ba92-2269-426c-839d-5343f05301fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f20ba92-2269-426c-839d-5343f05301fc', 'volume_size': 1} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-275351124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f20ba92-2269-426c-839d-5343f05301fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c65e1ec71548b786d728993543a662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:18Z,use_quota=True,user_id='94be5525335c4c6dab74b84c6d1ee67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Creating volume 5f20ba92-2269-426c-839d-5343f05301fc {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:45:18 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:18 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc 1073741824 Nov 02 11:45:18 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:18 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:45:18 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:19 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc 1073741824" returned: 0 in 1.071s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:19 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc Nov 02 11:45:19 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:19 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.846s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 8 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:45:19 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc" returned: 0 in 0.797s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:45:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2861d0c-0880-450a-911e-7d67f80c33e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f20ba92-2269-426c-839d-5343f05301fc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf811d2-84d5-4546-8628-f53687932e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Volume volume-5f20ba92-2269-426c-839d-5343f05301fc (5f20ba92-2269-426c-839d-5343f05301fc): created successfully Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf811d2-84d5-4546-8628-f53687932e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Flow 'volume_create_manager' (7e168bc7-d488-46a3-9f51-2886cf9eb489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:45:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-951ef9b4-2618-463e-87cb-64b8ef905429 tempest-ServerRescueNegativeTestJSON-1021018700 None] Created volume successfully. Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-ea0c2baf-a020-4404-a384-954c31187f9f req-d721db9f-2b25-4452-abd1-85e26af9666a tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-ea0c2baf-a020-4404-a384-954c31187f9f req-d721db9f-2b25-4452-abd1-85e26af9666a tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-ea0c2baf-a020-4404-a384-954c31187f9f req-d721db9f-2b25-4452-abd1-85e26af9666a tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-ea0c2baf-a020-4404-a384-954c31187f9f req-d721db9f-2b25-4452-abd1-85e26af9666a tempest-ServerActionsTestOtherA-217023053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-3e1680b0-ba94-4a52-9049-665d60eb79d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9be883e-6d62-4a50-b8cb-0c206da5a77d', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:45:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-ea0c2baf-a020-4404-a384-954c31187f9f req-d721db9f-2b25-4452-abd1-85e26af9666a tempest-ServerActionsTestOtherA-217023053 None] attachment_update completed successfully. Nov 02 11:45:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-a210cb1e-9483-4a8d-be58-883a927ba7b4 req-22e57f7f-4a73-4a29-ae59-2f3a47f8a89a tempest-ServerActionsTestOtherA-217023053 None] Terminate volume connection completed successfully. Nov 02 11:45:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-a210cb1e-9483-4a8d-be58-883a927ba7b4 req-22e57f7f-4a73-4a29-ae59-2f3a47f8a89a tempest-ServerActionsTestOtherA-217023053 None] Deleting attachment e9be883e-6d62-4a50-b8cb-0c206da5a77d. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:45:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a210cb1e-9483-4a8d-be58-883a927ba7b4 req-31374b24-fdc2-44b3-8d74-88bbd4c2fce7 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a210cb1e-9483-4a8d-be58-883a927ba7b4 req-31374b24-fdc2-44b3-8d74-88bbd4c2fce7 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a210cb1e-9483-4a8d-be58-883a927ba7b4 req-31374b24-fdc2-44b3-8d74-88bbd4c2fce7 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-a210cb1e-9483-4a8d-be58-883a927ba7b4 req-31374b24-fdc2-44b3-8d74-88bbd4c2fce7 tempest-ServerActionsTestOtherA-217023053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-3e1680b0-ba94-4a52-9049-665d60eb79d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1de1e27c-25f4-41d7-bd32-3c789c0b8c5d', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:45:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-a210cb1e-9483-4a8d-be58-883a927ba7b4 req-31374b24-fdc2-44b3-8d74-88bbd4c2fce7 tempest-ServerActionsTestOtherA-217023053 None] attachment_update completed successfully. Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Flow 'volume_create_manager' (0f14d058-0311-4216-8c46-4b26059495a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf0079f-859e-48b5-82df-d0a213cf0b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf0079f-859e-48b5-82df-d0a213cf0b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-186135550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9471528dc52342c482831b4f3469d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:35Z,use_quota=True,user_id='7827a13a4af9470cb0c3ae2bfc7f4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b9a66e-7854-4015-8330-00e1ee9211f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b9a66e-7854-4015-8330-00e1ee9211f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844a0c12-a3fc-4353-a619-7d975e3eb0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844a0c12-a3fc-4353-a619-7d975e3eb0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9', 'volume_name': 'volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0247151-1940-4c8b-998f-f6889a6c7799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0247151-1940-4c8b-998f-f6889a6c7799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2865094d-3a2a-4e3d-8db4-0649e6ba2157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:34 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Volume b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9', 'volume_size': 1} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-186135550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9471528dc52342c482831b4f3469d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:35Z,use_quota=True,user_id='7827a13a4af9470cb0c3ae2bfc7f4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Creating volume b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:45:34 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:45:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:34 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 1073741824 Nov 02 11:45:34 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Acquiring lock "cinder-5f20ba92-2269-426c-839d-5343f05301fc-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "cinder-5f20ba92-2269-426c-839d-5343f05301fc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Acquiring lock "cinder-quobyte-5f20ba92-2269-426c-839d-5343f05301fc" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "cinder-quobyte-5f20ba92-2269-426c-839d-5343f05301fc" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aeddc0-1cb6-443c-834a-67e3776e5215]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:35 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 1073741824" returned: 0 in 0.985s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:35 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 Nov 02 11:45:35 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:36 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc Nov 02 11:45:36 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:36 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2865094d-3a2a-4e3d-8db4-0649e6ba2157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a21c093-6b89-4ee1-9d9f-21207b910151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Volume volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 (b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9): created successfully Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a21c093-6b89-4ee1-9d9f-21207b910151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Flow 'volume_create_manager' (0f14d058-0311-4216-8c46-4b26059495a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:45:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-606230f0-0446-4308-accc-3c522da67e68 tempest-AttachVolumeTestJSON-1453177904 None] Created volume successfully. Nov 02 11:45:36 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc" returned: 0 in 0.852s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:36 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc Nov 02 11:45:36 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:37 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5f20ba92-2269-426c-839d-5343f05301fc" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "cinder-quobyte-5f20ba92-2269-426c-839d-5343f05301fc" released by "delete_volume" :: held 1.437s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Created reservations ['615bc566-6cb9-4eb2-8bc3-7e636eefc75e', 'e786a307-bfa2-4698-a30d-a3a9f7b471b4', 'aa6a7bf6-8d85-4f6f-8516-ce558c0907cc', '89d59761-91fa-417b-bf71-1a7104cc9799'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:37 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:45:37 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:38 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.607s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:45:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Deleted volume successfully. Nov 02 11:45:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab1987d0-ec2f-414d-8b0f-98dfb369af83 tempest-ServerRescueNegativeTestJSON-1021018700 None] Lock "cinder-5f20ba92-2269-426c-839d-5343f05301fc-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:45:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-9a986de7-3b76-4c91-b251-c541c2e2da11 req-f23319a1-f760-405b-82e0-91a2fb40a8f8 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-9a986de7-3b76-4c91-b251-c541c2e2da11 req-f23319a1-f760-405b-82e0-91a2fb40a8f8 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-9a986de7-3b76-4c91-b251-c541c2e2da11 req-f23319a1-f760-405b-82e0-91a2fb40a8f8 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-9a986de7-3b76-4c91-b251-c541c2e2da11 req-f23319a1-f760-405b-82e0-91a2fb40a8f8 tempest-AttachVolumeTestJSON-1453177904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8254b45e-112a-4afe-8b41-e3728b5403a2', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:45:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-9a986de7-3b76-4c91-b251-c541c2e2da11 req-f23319a1-f760-405b-82e0-91a2fb40a8f8 tempest-AttachVolumeTestJSON-1453177904 None] attachment_update completed successfully. Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Flow 'volume_create_manager' (c25ee928-a45c-424a-912e-36b12043e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d4ac1c-a822-4a79-ab56-15929cfa4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d4ac1c-a822-4a79-ab56-15929cfa4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2106871785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8c9885-3573-4200-bbd7-e0ab2d72c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9471528dc52342c482831b4f3469d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:44Z,use_quota=True,user_id='7827a13a4af9470cb0c3ae2bfc7f4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7962a712-6d65-48ce-a284-f4c65868839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7962a712-6d65-48ce-a284-f4c65868839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217c847a-0d26-4fcb-b88c-3e160f02dca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217c847a-0d26-4fcb-b88c-3e160f02dca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8c9885-3573-4200-bbd7-e0ab2d72c010', 'volume_name': 'volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bff551-21ed-4414-902d-285c3dc2e77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bff551-21ed-4414-902d-285c3dc2e77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d660fcf-2ad8-42de-bf5a-8f09a85d785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Volume 7a8c9885-3573-4200-bbd7-e0ab2d72c010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010', 'volume_size': 1} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2106871785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8c9885-3573-4200-bbd7-e0ab2d72c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9471528dc52342c482831b4f3469d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:44Z,use_quota=True,user_id='7827a13a4af9470cb0c3ae2bfc7f4538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Creating volume 7a8c9885-3573-4200-bbd7-e0ab2d72c010 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:45:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:45:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:44 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 1073741824 Nov 02 11:45:44 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:45 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 1073741824" returned: 0 in 0.790s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:45 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 Nov 02 11:45:45 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:45 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010" returned: 0 in 0.659s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:45:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d660fcf-2ad8-42de-bf5a-8f09a85d785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0cb7f4-ca70-42be-8fef-3cbbfc5a79ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Volume volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 (7a8c9885-3573-4200-bbd7-e0ab2d72c010): created successfully Nov 02 11:45:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0cb7f4-ca70-42be-8fef-3cbbfc5a79ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Flow 'volume_create_manager' (c25ee928-a45c-424a-912e-36b12043e93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:45:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7d33fee-e1e8-4ae8-af5e-586f300523cf tempest-AttachVolumeTestJSON-1453177904 None] Created volume successfully. Nov 02 11:45:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-03b605d0-9561-4ee0-bc96-2576ea34fdb4 req-d0c71e6f-4e50-488b-afcd-1e2435debd3c tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-03b605d0-9561-4ee0-bc96-2576ea34fdb4 req-d0c71e6f-4e50-488b-afcd-1e2435debd3c tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-03b605d0-9561-4ee0-bc96-2576ea34fdb4 req-d0c71e6f-4e50-488b-afcd-1e2435debd3c tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-03b605d0-9561-4ee0-bc96-2576ea34fdb4 req-d0c71e6f-4e50-488b-afcd-1e2435debd3c tempest-AttachVolumeTestJSON-1453177904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60ba1f2b-dc89-4715-9e05-c0596cc9e108', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:45:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-03b605d0-9561-4ee0-bc96-2576ea34fdb4 req-d0c71e6f-4e50-488b-afcd-1e2435debd3c tempest-AttachVolumeTestJSON-1453177904 None] attachment_update completed successfully. Nov 02 11:45:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-748cb2ae-4681-4c19-9490-158f2394470c req-2ad693d9-54d9-4a16-be51-09576f4c47c6 tempest-AttachVolumeTestJSON-1453177904 None] Terminate volume connection completed successfully. Nov 02 11:45:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-748cb2ae-4681-4c19-9490-158f2394470c req-2ad693d9-54d9-4a16-be51-09576f4c47c6 tempest-AttachVolumeTestJSON-1453177904 None] Deleting attachment 8254b45e-112a-4afe-8b41-e3728b5403a2. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:45:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-713c7a67-dff6-420b-a562-c540d046f2e1 req-b5391c7a-997e-45f4-911d-11b2a3042539 tempest-AttachVolumeTestJSON-1453177904 None] Terminate volume connection completed successfully. Nov 02 11:45:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-713c7a67-dff6-420b-a562-c540d046f2e1 req-b5391c7a-997e-45f4-911d-11b2a3042539 tempest-AttachVolumeTestJSON-1453177904 None] Deleting attachment 60ba1f2b-dc89-4715-9e05-c0596cc9e108. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:45:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "cinder-7a8c9885-3573-4200-bbd7-e0ab2d72c010-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:45:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-7a8c9885-3573-4200-bbd7-e0ab2d72c010-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:45:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "cinder-quobyte-7a8c9885-3573-4200-bbd7-e0ab2d72c010" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:45:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-quobyte-7a8c9885-3573-4200-bbd7-e0ab2d72c010" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:45:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4e110-1f6d-4438-9c90-7801dcf5724d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:45:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:58 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 Nov 02 11:45:58 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:59 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:45:59 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010 Nov 02 11:45:59 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Flow 'volume_create_manager' (6b3c0da1-f325-48a1-a91f-0912e5c942b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c810562f-48db-4821-9e9f-1ef5a8ae85df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c810562f-48db-4821-9e9f-1ef5a8ae85df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-81177233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ba8a4a-be23-445c-9a40-2ba0378e8f71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18f6c342e494466b9409f01305733a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:59Z,use_quota=True,user_id='6257360d22334708bb6a2974c2f62897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb84272-4ea7-4e6e-92a5-a885cd00ef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb84272-4ea7-4e6e-92a5-a885cd00ef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a19ccf-3d67-440c-8806-cec33ee2bf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a19ccf-3d67-440c-8806-cec33ee2bf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ba8a4a-be23-445c-9a40-2ba0378e8f71', 'volume_name': 'volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddba9db8-5189-4c66-a8df-8e45374c620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddba9db8-5189-4c66-a8df-8e45374c620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3365e962-0757-4b74-989f-69cd343b0a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:45:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Volume b3ba8a4a-be23-445c-9a40-2ba0378e8f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71', 'volume_size': 1} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-81177233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ba8a4a-be23-445c-9a40-2ba0378e8f71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18f6c342e494466b9409f01305733a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:45:59Z,use_quota=True,user_id='6257360d22334708bb6a2974c2f62897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Creating volume b3ba8a4a-be23-445c-9a40-2ba0378e8f71 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:45:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:59 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 1073741824 Nov 02 11:45:59 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:59 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7a8c9885-3573-4200-bbd7-e0ab2d72c010" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-quobyte-7a8c9885-3573-4200-bbd7-e0ab2d72c010" released by "delete_volume" :: held 0.685s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Created reservations ['1ca1fb7b-2afd-4fd4-8f84-7fb81e711757', '434fe581-560d-4fb0-b732-d0c38341cf76', '352166bf-321f-44c3-b731-9474c0bed759', '46fce8ff-d972-4c54-b8ee-ffd76655c08f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:59 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:45:59 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:59 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 1073741824" returned: 0 in 0.478s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:45:59 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 Nov 02 11:45:59 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:45:59 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "cinder-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:45:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Deleted volume successfully. Nov 02 11:45:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-96cde981-babe-4e7e-92ca-49b635d2f745 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-7a8c9885-3573-4200-bbd7-e0ab2d72c010-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "cinder-quobyte-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-quobyte-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaace59-9440-40c4-92cd-d1fae32c3b1b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:00 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71" returned: 0 in 0.335s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3365e962-0757-4b74-989f-69cd343b0a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b94ebf7-7043-4d5a-9a5f-a1e66413327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:00 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 Nov 02 11:46:00 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Volume volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 (b3ba8a4a-be23-445c-9a40-2ba0378e8f71): created successfully Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b94ebf7-7043-4d5a-9a5f-a1e66413327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Flow 'volume_create_manager' (6b3c0da1-f325-48a1-a91f-0912e5c942b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-96b45029-c86d-4fa6-aa3a-94682dd56199 tempest-VolumesTestJSON-1234988116 None] Created volume successfully. Nov 02 11:46:00 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:00 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9 Nov 02 11:46:00 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:00 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-quobyte-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9" released by "delete_volume" :: held 0.734s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Created reservations ['681dd9b3-02d3-4b71-974e-c579a30b68ee', '056ec185-5d2c-45c0-ac89-87681aee7bad', 'b412d235-5a1a-4416-8470-6f5b9ec05924', '7f52fb3f-69a1-4eb5-85a9-519ef2056270'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:00 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:00 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:01 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Deleted volume successfully. Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2374cc56-52f9-418d-90f2-62a9127d3c80 tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-b6eb7eea-a5fe-4fc9-bacd-11d942efe5e9-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "cinder-c6149854-4866-409b-a6e6-23c5be9244ed-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-c6149854-4866-409b-a6e6-23c5be9244ed-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "cinder-quobyte-c6149854-4866-409b-a6e6-23c5be9244ed" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-quobyte-c6149854-4866-409b-a6e6-23c5be9244ed" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b2b77-d658-4b2b-8681-f86e4e59d548]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:01 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed Nov 02 11:46:01 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:01 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed" returned: 0 in 0.379s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:01 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed Nov 02 11:46:01 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:02 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6149854-4866-409b-a6e6-23c5be9244ed" returned: 0 in 0.324s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-quobyte-c6149854-4866-409b-a6e6-23c5be9244ed" released by "delete_volume" :: held 0.762s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Flow 'volume_create_manager' (4eb37dce-cd63-4318-972e-44b9ddad2b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c32cbc-2bce-4b91-82d0-40be2cc9c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c32cbc-2bce-4b91-82d0-40be2cc9c806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-396516799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74880c9a-b8a2-4020-b6b7-e72323d8daf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18f6c342e494466b9409f01305733a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:02Z,use_quota=True,user_id='6257360d22334708bb6a2974c2f62897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e6606d-7a43-421a-83e4-1ba9ef485882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e6606d-7a43-421a-83e4-1ba9ef485882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c376ca-47c1-49de-a130-2945ac5ae917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c376ca-47c1-49de-a130-2945ac5ae917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74880c9a-b8a2-4020-b6b7-e72323d8daf5', 'volume_name': 'volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a6d372-b0e4-468f-bafd-5f0b10a94716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a6d372-b0e4-468f-bafd-5f0b10a94716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7ab6e5-5c7c-48bc-a7e9-dc2eca58cbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Volume 74880c9a-b8a2-4020-b6b7-e72323d8daf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5', 'volume_size': 1} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-396516799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74880c9a-b8a2-4020-b6b7-e72323d8daf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18f6c342e494466b9409f01305733a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:02Z,use_quota=True,user_id='6257360d22334708bb6a2974c2f62897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Creating volume 74880c9a-b8a2-4020-b6b7-e72323d8daf5 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:02 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Created reservations ['dbf16119-b90c-49a6-9271-7775cbdd6d01', 'df9bce40-834e-479a-8881-0823169e4f3f', '7116ede3-8245-43d4-b413-b5aa9c28cc01', '153e4ad7-b0ec-4f74-9913-aa85b9bea326'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:02 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 1073741824 Nov 02 11:46:02 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:02 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:02 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:02 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Deleted volume successfully. Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e363ae3a-dea0-4f2b-b801-eff7ddd6e2ba tempest-AttachVolumeTestJSON-1453177904 None] Lock "cinder-c6149854-4866-409b-a6e6-23c5be9244ed-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:02 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 1073741824" returned: 0 in 0.596s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:02 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 Nov 02 11:46:02 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:03 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=69,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7ab6e5-5c7c-48bc-a7e9-dc2eca58cbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2780fdb0-d057-4001-84db-96109ec1233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=51,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:46:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Volume volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 (74880c9a-b8a2-4020-b6b7-e72323d8daf5): created successfully Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2780fdb0-d057-4001-84db-96109ec1233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Flow 'volume_create_manager' (4eb37dce-cd63-4318-972e-44b9ddad2b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-88292740-1340-47a1-9646-4092fdfa6b09 tempest-VolumesTestJSON-1234988116 None] Created volume successfully. Nov 02 11:46:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-e5a2e40a-c248-49ae-96c9-afd5114615ef req-87b9e974-cebf-4503-8a52-77f409795c93 tempest-ServerActionsTestOtherA-217023053 None] Terminate volume connection completed successfully. Nov 02 11:46:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-e5a2e40a-c248-49ae-96c9-afd5114615ef req-87b9e974-cebf-4503-8a52-77f409795c93 tempest-ServerActionsTestOtherA-217023053 None] Deleting attachment 1de1e27c-25f4-41d7-bd32-3c789c0b8c5d. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Flow 'volume_create_manager' (7464358f-befc-4875-943f-4e314348163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6bba23-4185-4a9f-bac4-2b9e2867e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6bba23-4185-4a9f-bac4-2b9e2867e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1766838858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4fbd79-aa57-4c7f-9862-d8aada5929e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18f6c342e494466b9409f01305733a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:05Z,use_quota=True,user_id='6257360d22334708bb6a2974c2f62897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff292ce-d9b2-4841-b269-634def6ed985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff292ce-d9b2-4841-b269-634def6ed985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca7062e-a301-463e-984e-9c9a13a44ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca7062e-a301-463e-984e-9c9a13a44ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4fbd79-aa57-4c7f-9862-d8aada5929e6', 'volume_name': 'volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde652df-ec6e-4dff-adea-6acc2bf7996b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde652df-ec6e-4dff-adea-6acc2bf7996b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de138f06-145d-4699-9c43-9d0be5177107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Volume dc4fbd79-aa57-4c7f-9862-d8aada5929e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6', 'volume_size': 1} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1766838858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4fbd79-aa57-4c7f-9862-d8aada5929e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='18f6c342e494466b9409f01305733a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:05Z,use_quota=True,user_id='6257360d22334708bb6a2974c2f62897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Creating volume dc4fbd79-aa57-4c7f-9862-d8aada5929e6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:05 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:05 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 1073741824 Nov 02 11:46:05 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:05 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 1073741824" returned: 0 in 0.686s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:06 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 Nov 02 11:46:06 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:06 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de138f06-145d-4699-9c43-9d0be5177107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d1c1d4-78af-42ab-9a8f-688cd6f761af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Volume volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 (dc4fbd79-aa57-4c7f-9862-d8aada5929e6): created successfully Nov 02 11:46:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d1c1d4-78af-42ab-9a8f-688cd6f761af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Flow 'volume_create_manager' (7464358f-befc-4875-943f-4e314348163c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9f9c4e7c-79df-42a9-b23a-e27582a183f8 tempest-VolumesTestJSON-1234988116 None] Created volume successfully. Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Acquiring lock "cinder-dc4fbd79-aa57-4c7f-9862-d8aada5929e6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Lock "cinder-dc4fbd79-aa57-4c7f-9862-d8aada5929e6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Acquiring lock "cinder-quobyte-dc4fbd79-aa57-4c7f-9862-d8aada5929e6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Lock "cinder-quobyte-dc4fbd79-aa57-4c7f-9862-d8aada5929e6" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2d041-48ed-4087-b0b0-c0d0dd1eabca]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:08 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 Nov 02 11:46:08 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:08 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:09 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6 Nov 02 11:46:09 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:09 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dc4fbd79-aa57-4c7f-9862-d8aada5929e6" returned: 0 in 0.378s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Lock "cinder-quobyte-dc4fbd79-aa57-4c7f-9862-d8aada5929e6" released by "delete_volume" :: held 0.902s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Created reservations ['825d714f-4538-4509-849b-c87f8fbef2dd', '5cebb932-b076-446f-9ddd-9487f4de3bcc', 'f56d5b1a-0321-414a-981a-45e2a9018a40', '29b4b54d-479f-4059-b6e6-c67dbbc8a22f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Flow 'volume_create_manager' (124868c8-4dec-4c64-8f09-74d5a76b8c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0105e0b-8fc5-4bc3-a0d7-4ef846314c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0105e0b-8fc5-4bc3-a0d7-4ef846314c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-750580185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b10ed1-510d-4b79-9f19-cf1122fbf928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28bc9d5b5324c33874e9b0bb580e62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:10Z,use_quota=True,user_id='6670090b4c394871921fc41b2b2c43e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:09 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b41d04e-9b60-4671-a309-595bc459e990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:09 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b41d04e-9b60-4671-a309-595bc459e990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a01de7-98a5-4cba-9376-428de288f5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a01de7-98a5-4cba-9376-428de288f5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b10ed1-510d-4b79-9f19-cf1122fbf928', 'volume_name': 'volume-49b10ed1-510d-4b79-9f19-cf1122fbf928', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3416302f-0b05-470a-bf8f-4a276ebe6f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3416302f-0b05-470a-bf8f-4a276ebe6f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b87b82-a005-4878-8ae3-217a863351c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Volume 49b10ed1-510d-4b79-9f19-cf1122fbf928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b10ed1-510d-4b79-9f19-cf1122fbf928', 'volume_size': 1} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-750580185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b10ed1-510d-4b79-9f19-cf1122fbf928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28bc9d5b5324c33874e9b0bb580e62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:10Z,use_quota=True,user_id='6670090b4c394871921fc41b2b2c43e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Creating volume 49b10ed1-510d-4b79-9f19-cf1122fbf928 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:09 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:09 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 1073741824 Nov 02 11:46:09 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:10 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Deleted volume successfully. Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-817c2aa6-a18c-4918-9bac-485de9c2edab tempest-VolumesTestJSON-1234988116 None] Lock "cinder-dc4fbd79-aa57-4c7f-9862-d8aada5929e6-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:10 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 1073741824" returned: 0 in 0.567s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:10 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 Nov 02 11:46:10 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:10 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b87b82-a005-4878-8ae3-217a863351c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b10ed1-510d-4b79-9f19-cf1122fbf928', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad48a40-2440-4bb1-973c-60f226895a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "cinder-74880c9a-b8a2-4020-b6b7-e72323d8daf5-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Volume volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 (49b10ed1-510d-4b79-9f19-cf1122fbf928): created successfully Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad48a40-2440-4bb1-973c-60f226895a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Flow 'volume_create_manager' (124868c8-4dec-4c64-8f09-74d5a76b8c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-74880c9a-b8a2-4020-b6b7-e72323d8daf5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-853f4ea5-4e22-43ea-90b8-9a139f83492d tempest-AttachVolumeNegativeTest-1244714756 None] Created volume successfully. Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "cinder-quobyte-74880c9a-b8a2-4020-b6b7-e72323d8daf5" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-quobyte-74880c9a-b8a2-4020-b6b7-e72323d8daf5" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8d01db-adfe-4100-86ce-b2820158d007]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:11 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 Nov 02 11:46:11 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:11 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:11 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5 Nov 02 11:46:11 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:11 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74880c9a-b8a2-4020-b6b7-e72323d8daf5" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-quobyte-74880c9a-b8a2-4020-b6b7-e72323d8daf5" released by "delete_volume" :: held 0.764s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Created reservations ['25e31e1e-6801-4a76-8b8d-4687f8bb642c', 'a15e989b-6678-4fb7-b841-9ebc43c7d847', '8e7ed4a8-f5d9-4f9e-aecb-410060b4b19c', '68d67aba-2b72-4061-a41d-a4e6a50b540b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:11 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:11 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Flow 'volume_create_manager' (6b19ec98-7686-4852-94f6-ee02b1771b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb492e75-8454-4ec3-9500-55b79dbbd006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb492e75-8454-4ec3-9500-55b79dbbd006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-264358190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f684da12825c4dab95cc04623085c4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:12Z,use_quota=True,user_id='2590b3c6bd154cab825f9df9a2645ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6969a94-d911-4b65-9a91-d427e9cd4a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6969a94-d911-4b65-9a91-d427e9cd4a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b931a5-811f-4f45-b803-6155df522b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:11 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "cinder-b3ba8a4a-be23-445c-9a40-2ba0378e8f71-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-b3ba8a4a-be23-445c-9a40-2ba0378e8f71-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:12 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Deleted volume successfully. Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "cinder-quobyte-b3ba8a4a-be23-445c-9a40-2ba0378e8f71" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-quobyte-b3ba8a4a-be23-445c-9a40-2ba0378e8f71" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-78562c74-7949-44a7-a1d0-2f4b7eb5dc77 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-74880c9a-b8a2-4020-b6b7-e72323d8daf5-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f3d71-6c9e-495a-9c60-b3ce1f956563]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:12 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 Nov 02 11:46:12 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:12 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71" returned: 0 in 0.553s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:12 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71 Nov 02 11:46:12 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-725c34e9-5949-407c-bbeb-90b4353997bc req-eb0ae6d6-bdca-4bfc-bb0a-e91c0b5e3e16 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-725c34e9-5949-407c-bbeb-90b4353997bc req-eb0ae6d6-bdca-4bfc-bb0a-e91c0b5e3e16 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-725c34e9-5949-407c-bbeb-90b4353997bc req-eb0ae6d6-bdca-4bfc-bb0a-e91c0b5e3e16 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b931a5-811f-4f45-b803-6155df522b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985', 'volume_name': 'volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1e3116-ba0d-44ec-80b5-6e598a498e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1e3116-ba0d-44ec-80b5-6e598a498e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e73b46-e772-4d8a-bd74-fa05665cf785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Volume 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Trying to clone 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:46:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-725c34e9-5949-407c-bbeb-90b4353997bc req-eb0ae6d6-bdca-4bfc-bb0a-e91c0b5e3e16 tempest-AttachVolumeNegativeTest-1244714756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-49b10ed1-510d-4b79-9f19-cf1122fbf928', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '516b1d81-687a-40bd-b89a-68b7a3d22662', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:46:13 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3ba8a4a-be23-445c-9a40-2ba0378e8f71" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-725c34e9-5949-407c-bbeb-90b4353997bc req-eb0ae6d6-bdca-4bfc-bb0a-e91c0b5e3e16 tempest-AttachVolumeNegativeTest-1244714756 None] attachment_update completed successfully. Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-quobyte-b3ba8a4a-be23-445c-9a40-2ba0378e8f71" released by "delete_volume" :: held 0.929s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Created reservations ['6e906c08-2906-4cc2-93ba-b5d6e502a341', '53cad62e-c515-43a3-a132-6eaddf30a47e', '2ec82164-500e-4710-b652-d74083ed007f', '749adec6-6a25-4bea-a220-6ed62f9446d4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:46:13 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Image download 20.69 MB at 20.69 MB/s Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:13 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:13 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e1c64-82c0-4b62-a445-cabf27c1d9ec]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Flow 'volume_create_manager' (97076246-6f58-4dd2-9599-0059973f0f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae3f4b9-7118-4a9f-9c21-3c409478609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae3f4b9-7118-4a9f-9c21-3c409478609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-283945543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddcac832-c5d9-492f-aa52-2a1366fb1757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13de5f0f4ed643ea8d7f9346f06c9ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:13Z,use_quota=True,user_id='4416bef3814c4666be11030d885df903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9263aa0d-4f64-480c-b686-8b996824c02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9263aa0d-4f64-480c-b686-8b996824c02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6167ead-ec35-407b-beb3-49218d0b1d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6167ead-ec35-407b-beb3-49218d0b1d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddcac832-c5d9-492f-aa52-2a1366fb1757', 'volume_name': 'volume-ddcac832-c5d9-492f-aa52-2a1366fb1757', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5db1c9-b83e-4eb7-80da-5ccbbe05b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:13 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD Nov 02 11:46:13 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5db1c9-b83e-4eb7-80da-5ccbbe05b30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0fb76d-a264-415a-9db6-f3fdb243053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Volume ddcac832-c5d9-492f-aa52-2a1366fb1757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddcac832-c5d9-492f-aa52-2a1366fb1757', 'volume_size': 1} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-283945543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddcac832-c5d9-492f-aa52-2a1366fb1757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13de5f0f4ed643ea8d7f9346f06c9ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:13Z,use_quota=True,user_id='4416bef3814c4666be11030d885df903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Creating volume ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:13 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 1073741824 Nov 02 11:46:13 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:13 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.333s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Deleted volume successfully. Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0168e82e-452d-48ef-b8ed-ccfec38c4ef0 tempest-VolumesTestJSON-1234988116 None] Lock "cinder-b3ba8a4a-be23-445c-9a40-2ba0378e8f71-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:13 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:13 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 is fetched for user 2590b3c6bd154cab825f9df9a2645ddf. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e7315-4385-4217-842e-de67324f066e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:14 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD Nov 02 11:46:14 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:14 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 1073741824" returned: 0 in 0.591s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:14 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 Nov 02 11:46:14 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:14 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:14 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757" returned: 0 in 0.365s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.266s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-264358190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f684da12825c4dab95cc04623085c4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:12Z,use_quota=True,user_id='2590b3c6bd154cab825f9df9a2645ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Creating volume 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:14 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0fb76d-a264-415a-9db6-f3fdb243053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddcac832-c5d9-492f-aa52-2a1366fb1757', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:14 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 1073741824 Nov 02 11:46:14 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c62bd3-717c-4f5d-a286-d4d86909f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Volume volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 (ddcac832-c5d9-492f-aa52-2a1366fb1757): created successfully Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c62bd3-717c-4f5d-a286-d4d86909f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Flow 'volume_create_manager' (97076246-6f58-4dd2-9599-0059973f0f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-20ed9cb5-3262-47db-b773-e1c03ce067ab req-0ed9d014-24c3-42ad-a5a0-70654042c37a tempest-VolumesSnapshotsTestJSON-1628207606 None] Created volume successfully. Nov 02 11:46:15 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 1073741824" returned: 0 in 0.610s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:15 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 Nov 02 11:46:15 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:15 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985" returned: 0 in 0.364s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Attempting download of 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:46:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-128844b0-0831-4c3e-9af3-92c76ea14d43 req-9606c179-b191-47ba-b4ad-af68a2a2b34e tempest-AttachVolumeNegativeTest-1244714756 None] Terminate volume connection completed successfully. Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-128844b0-0831-4c3e-9af3-92c76ea14d43 req-9606c179-b191-47ba-b4ad-af68a2a2b34e tempest-AttachVolumeNegativeTest-1244714756 None] Deleting attachment 516b1d81-687a-40bd-b89a-68b7a3d22662. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ade033-4d50-4284-8ab3-30c34bead1a0]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_eixiduru {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:16 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_eixiduru Nov 02 11:46:16 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Creating offline snapshot 8f882e22-32b6-4256-b18e-d16f811ab1e4 of volume ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a7c16-ccd5-464c-8b85-b1c488e701ee]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:16 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_eixiduru" returned: 0 in 0.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_eixiduru {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:16 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 Nov 02 11:46:16 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:16 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_eixiduru Nov 02 11:46:16 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:16 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757" returned: 0 in 0.561s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:16 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 1G Nov 02 11:46:16 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:16 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_eixiduru" returned: 1 in 0.612s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_eixiduru' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6e7430-3b4d-4930-8737-3a39bcc5c729]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:17 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD Nov 02 11:46:17 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:17 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD" returned: 0 in 0.630s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:17 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 1G" returned: 0 in 0.737s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:17 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 Nov 02 11:46:17 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:17 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 Nov 02 11:46:17 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:18 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:18 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 is being set with open permissions: ugo+rw Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:18 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 Nov 02 11:46:18 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:18 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:18 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.info Nov 02 11:46:18 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:18 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:18 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:19 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.info" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.info is being set with open permissions: ugo+rw Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:19 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.info Nov 02 11:46:19 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:19 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:46:19 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.info" returned: 0 in 0.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-162888a9-f44f-46f6-96e5-a710e89b012e req-ddfe1d3a-5f64-4935-933b-b9aeed9464db tempest-VolumesSnapshotsTestJSON-1628207606 None] Create snapshot completed successfully Nov 02 11:46:20 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985" returned: 0 in 2.565s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_i6mhkzpjdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:46:20 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Converted 112.00 MB image at 43.63 MB/s Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:20 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 1G Nov 02 11:46:20 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "cinder-8f882e22-32b6-4256-b18e-d16f811ab1e4-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-8f882e22-32b6-4256-b18e-d16f811ab1e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "cinder-quobyte-ddcac832-c5d9-492f-aa52-2a1366fb1757" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-quobyte-ddcac832-c5d9-492f-aa52-2a1366fb1757" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "cinder-quobyte-8f882e22-32b6-4256-b18e-d16f811ab1e4" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-quobyte-8f882e22-32b6-4256-b18e-d16f811ab1e4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Deleting offline snapshot 8f882e22-32b6-4256-b18e-d16f811ab1e4 of volume ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] snapshot_file for this snap is: volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa8c2a0-3a85-4926-857a-5a4d49bcfac2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:20 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 Nov 02 11:46:20 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:20 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 1G" returned: 0 in 0.384s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Downloaded image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 for user 2590b3c6bd154cab825f9df9a2645ddf is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Marking volume 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Copying metadata from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 to 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Creating volume glance metadata for volume 2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 backed by image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e73b46-e772-4d8a-bd74-fa05665cf785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37893f5-983a-44bb-98ce-6fa5cf4adce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Volume volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 (2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985): created successfully Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37893f5-983a-44bb-98ce-6fa5cf4adce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Flow 'volume_create_manager' (6b19ec98-7686-4852-94f6-ee02b1771b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4d03bc1b-8e7c-410a-8c31-71837c33957a tempest-ServerActionsTestOtherA-217023053 None] Created volume successfully. Nov 02 11:46:20 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4" returned: 0 in 0.438s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddcac832-c5d9-492f-aa52-2a1366fb1757(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[753ef9af-bcf1-41dc-87d8-bbfeb936086d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:21 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 Nov 02 11:46:21 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:21 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757" returned: 0 in 0.438s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:21 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 Nov 02 11:46:21 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:21 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4" returned: 0 in 0.500s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:21 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4 Nov 02 11:46:21 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:22 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757.8f882e22-32b6-4256-b18e-d16f811ab1e4" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-quobyte-8f882e22-32b6-4256-b18e-d16f811ab1e4" released by "_delete_snapshot" :: held 1.891s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-quobyte-ddcac832-c5d9-492f-aa52-2a1366fb1757" released by "delete_snapshot" :: held 1.925s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:22 devstack cinder-volume[86846]: WARNING cinder.quota [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.quota [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Created reservations ['b07a9a3b-36f0-40b7-baaa-56b7be948dc7', '9be7a574-2377-4092-99fc-3d17f033d8e8', 'e92cb6ff-d34f-44a9-ac47-932db1229c26', 'f9d450ce-2209-442d-9924-4cf14afd8d3a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Delete snapshot completed successfully. Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08e2651b-a63c-4f8b-946a-10ca3d5289ee req-33f3134f-407f-4c2a-8275-5de73df9d1af tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-8f882e22-32b6-4256-b18e-d16f811ab1e4-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "cinder-ddcac832-c5d9-492f-aa52-2a1366fb1757-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-ddcac832-c5d9-492f-aa52-2a1366fb1757-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "cinder-quobyte-ddcac832-c5d9-492f-aa52-2a1366fb1757" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-quobyte-ddcac832-c5d9-492f-aa52-2a1366fb1757" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb0efda-1e0b-4cd3-988d-947a8af6feb7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:23 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 Nov 02 11:46:23 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:23 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757" returned: 0 in 0.487s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:23 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757 Nov 02 11:46:23 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:23 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ddcac832-c5d9-492f-aa52-2a1366fb1757" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-quobyte-ddcac832-c5d9-492f-aa52-2a1366fb1757" released by "delete_volume" :: held 0.908s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG cinder.quota [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Created reservations ['3828e283-a8ce-4969-9032-8d7bb216e318', '0b1c38eb-76b7-46fa-9f1b-716b5ca1d11d', 'f0c6e15d-a5e5-4d8d-a9cb-e535c51ca53d', 'abec9716-437b-4edc-9113-d6ae504fda00'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:24 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:24 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:24 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:24 devstack cinder-volume[86846]: DEBUG cinder.manager [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Deleted volume successfully. Nov 02 11:46:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-08386642-55a8-413b-958f-478046a40e59 req-b21e89c3-6bbc-48ed-bf38-c48a74ae6854 tempest-VolumesSnapshotsTestJSON-1628207606 None] Lock "cinder-ddcac832-c5d9-492f-aa52-2a1366fb1757-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a0fb0b6d-4f06-4e7f-be1f-0c69e0fa97c0 req-6b30c081-dfae-49a0-ab25-9d525a8c3909 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a0fb0b6d-4f06-4e7f-be1f-0c69e0fa97c0 req-6b30c081-dfae-49a0-ab25-9d525a8c3909 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-a0fb0b6d-4f06-4e7f-be1f-0c69e0fa97c0 req-6b30c081-dfae-49a0-ab25-9d525a8c3909 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-a0fb0b6d-4f06-4e7f-be1f-0c69e0fa97c0 req-6b30c081-dfae-49a0-ab25-9d525a8c3909 tempest-ServerActionsTestOtherA-217023053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3b8b397-ca83-4407-9071-9f612a3bab32', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:46:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-a0fb0b6d-4f06-4e7f-be1f-0c69e0fa97c0 req-6b30c081-dfae-49a0-ab25-9d525a8c3909 tempest-ServerActionsTestOtherA-217023053 None] attachment_update completed successfully. Nov 02 11:46:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-471c8615-ac4e-4207-af90-df7109e743cc tempest-GroupsTest-1839460627 None] Group tempest-Group1-637734637: creating Nov 02 11:46:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-471c8615-ac4e-4207-af90-df7109e743cc tempest-GroupsTest-1839460627 None] Group tempest-Group1-637734637: created successfully Nov 02 11:46:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-471c8615-ac4e-4207-af90-df7109e743cc tempest-GroupsTest-1839460627 None] Create group completed successfully. Nov 02 11:46:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7251912-252f-47a0-8510-28eccdd1f740 tempest-GroupsTest-1839460627 None] Group tempest-Group2-1783723189: creating Nov 02 11:46:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7251912-252f-47a0-8510-28eccdd1f740 tempest-GroupsTest-1839460627 None] Group tempest-Group2-1783723189: created successfully Nov 02 11:46:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7251912-252f-47a0-8510-28eccdd1f740 tempest-GroupsTest-1839460627 None] Create group completed successfully. Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Flow 'volume_create_manager' (e01ea39a-2667-4872-9cd8-249d454a3693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2124f913-f278-4bd8-9ade-f3cdf73bca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2124f913-f278-4bd8-9ade-f3cdf73bca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902924868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de013d7c-8f27-4e52-9e4a-bfb4bfc971b8,host='devstack@QuobyteHD#QuobyteHD',id=83ef6e6b-6f4c-4171-9240-f374f310e962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47900887f245018c22c100f68bef50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:30Z,use_quota=True,user_id='fcf3ae7cc917403183c3894dc4ffb59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d84d3b4-b230-4172-a909-f6cd3280a5c0),volume_type_id=2d84d3b4-b230-4172-a909-f6cd3280a5c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e326683-9110-4ea1-9c73-3b30e3efb100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e326683-9110-4ea1-9c73-3b30e3efb100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918e5416-5ca3-4578-b365-7d17f1924977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918e5416-5ca3-4578-b365-7d17f1924977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ef6e6b-6f4c-4171-9240-f374f310e962', 'volume_name': 'volume-83ef6e6b-6f4c-4171-9240-f374f310e962', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b77ec64-7ead-4ab1-8c18-9be99709f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b77ec64-7ead-4ab1-8c18-9be99709f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5262dd4-f326-4eb3-ad12-2e7fd46f8923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Volume 83ef6e6b-6f4c-4171-9240-f374f310e962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ef6e6b-6f4c-4171-9240-f374f310e962', 'volume_size': 1} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=de013d7c-8f27-4e52-9e4a-bfb4bfc971b8,created_at=2026-11-02T10:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902924868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de013d7c-8f27-4e52-9e4a-bfb4bfc971b8,host='devstack@QuobyteHD#QuobyteHD',id=83ef6e6b-6f4c-4171-9240-f374f310e962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47900887f245018c22c100f68bef50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:30Z,use_quota=True,user_id='fcf3ae7cc917403183c3894dc4ffb59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d84d3b4-b230-4172-a909-f6cd3280a5c0),volume_type_id=2d84d3b4-b230-4172-a909-f6cd3280a5c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Creating volume 83ef6e6b-6f4c-4171-9240-f374f310e962 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:30 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:30 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 1073741824 Nov 02 11:46:30 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:30 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 1073741824" returned: 0 in 0.833s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:30 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 Nov 02 11:46:30 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:31 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962" returned: 0 in 0.443s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5262dd4-f326-4eb3-ad12-2e7fd46f8923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ef6e6b-6f4c-4171-9240-f374f310e962', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f115e3-91f3-4616-b4b3-4545ae8bb4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Volume volume-83ef6e6b-6f4c-4171-9240-f374f310e962 (83ef6e6b-6f4c-4171-9240-f374f310e962): created successfully Nov 02 11:46:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f115e3-91f3-4616-b4b3-4545ae8bb4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Flow 'volume_create_manager' (e01ea39a-2667-4872-9cd8-249d454a3693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-016c6b2c-ac6f-43aa-965d-7c5221a57533 tempest-GroupsTest-1839460627 None] Created volume successfully. Nov 02 11:46:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-918d4c8f-73f9-4d78-a1bf-71737667dd90 tempest-GroupSnapshotsV319Test-324324584 None] Group tempest-GroupSnapshotsV319Test-Group-597472024: creating Nov 02 11:46:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-918d4c8f-73f9-4d78-a1bf-71737667dd90 tempest-GroupSnapshotsV319Test-324324584 None] Group tempest-GroupSnapshotsV319Test-Group-597472024: created successfully Nov 02 11:46:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-918d4c8f-73f9-4d78-a1bf-71737667dd90 tempest-GroupSnapshotsV319Test-324324584 None] Create group completed successfully. Nov 02 11:46:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Acquiring lock "cinder-quobyte-83ef6e6b-6f4c-4171-9240-f374f310e962" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Lock "cinder-quobyte-83ef6e6b-6f4c-4171-9240-f374f310e962" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[384355ab-d148-4f67-9d85-5208ceede824]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Flow 'volume_create_manager' (90c39277-459d-4e65-8045-d2095b719c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9167be66-4ca3-4dca-960f-a0000672ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9167be66-4ca3-4dca-960f-a0000672ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933050850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24e720df-4dbc-4dd0-b0c2-ea462e41c2fb,host='devstack@QuobyteHD#QuobyteHD',id=a3eba549-1867-4384-8e5d-66bf1bd2e595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2b2c7564124bd68447a23b8ceff1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:35Z,use_quota=True,user_id='164ac514adeb49ceb535ac4b90e2ce4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ff0bfd1-e5a5-4f77-92c6-0e49767c3663),volume_type_id=8ff0bfd1-e5a5-4f77-92c6-0e49767c3663)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:35 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 Nov 02 11:46:35 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e19eeb0-66c2-4095-89d1-bb3c5df43b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e19eeb0-66c2-4095-89d1-bb3c5df43b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c5230c-62b2-462a-b9be-6c81d6b91eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c5230c-62b2-462a-b9be-6c81d6b91eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3eba549-1867-4384-8e5d-66bf1bd2e595', 'volume_name': 'volume-a3eba549-1867-4384-8e5d-66bf1bd2e595', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c295bcd-7205-453d-9f82-eb55ac02d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c295bcd-7205-453d-9f82-eb55ac02d762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4436387-2abc-41bd-85e4-2b90fae462be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Volume a3eba549-1867-4384-8e5d-66bf1bd2e595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3eba549-1867-4384-8e5d-66bf1bd2e595', 'volume_size': 1} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24e720df-4dbc-4dd0-b0c2-ea462e41c2fb,created_at=2026-11-02T10:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933050850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24e720df-4dbc-4dd0-b0c2-ea462e41c2fb,host='devstack@QuobyteHD#QuobyteHD',id=a3eba549-1867-4384-8e5d-66bf1bd2e595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2b2c7564124bd68447a23b8ceff1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:35Z,use_quota=True,user_id='164ac514adeb49ceb535ac4b90e2ce4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ff0bfd1-e5a5-4f77-92c6-0e49767c3663),volume_type_id=8ff0bfd1-e5a5-4f77-92c6-0e49767c3663)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Creating volume a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:35 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 1073741824 Nov 02 11:46:35 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:36 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962" returned: 0 in 1.104s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:36 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962 Nov 02 11:46:36 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:36 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-83ef6e6b-6f4c-4171-9240-f374f310e962" returned: 0 in 0.658s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Lock "cinder-quobyte-83ef6e6b-6f4c-4171-9240-f374f310e962" released by "delete_volume" :: held 1.916s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:36 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 1073741824" returned: 0 in 1.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Created reservations ['9d7e355e-7cc3-4882-9ecf-4fd203b794e3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:37 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 Nov 02 11:46:37 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:37 devstack cinder-volume[86846]: WARNING cinder.quota [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-27851765 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-27851765, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:37 devstack cinder-volume[86846]: WARNING cinder.quota [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-27851765 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-27851765, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Created reservations ['77a54b00-7163-4d92-ac0f-6861634c0f93', 'b89a8aae-9109-4ad5-bfac-3f8e4da1673c', 'e6df7202-720b-40d7-9824-02f860a07681', '5137931d-f08d-4560-b427-594a3aba3a25'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:37 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595" returned: 0 in 0.642s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:37 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:37 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4436387-2abc-41bd-85e4-2b90fae462be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3eba549-1867-4384-8e5d-66bf1bd2e595', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67763250-312a-4a1c-a48d-f9315f32ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Volume volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 (a3eba549-1867-4384-8e5d-66bf1bd2e595): created successfully Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67763250-312a-4a1c-a48d-f9315f32ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Flow 'volume_create_manager' (90c39277-459d-4e65-8045-d2095b719c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a0e32b93-864c-4fed-931a-cfde22294f4d tempest-GroupSnapshotsV319Test-324324584 None] Created volume successfully. Nov 02 11:46:38 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9605c4ec-5242-4772-8686-903e522ebadb tempest-GroupsTest-1839460627 None] Delete group completed successfully. Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Created reservations ['46e7e3f1-35b5-4e21-b1d5-342531e2ab2b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:38 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:38 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:39 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.562s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-844bc8de-d0b6-4703-8d75-954f81af9ae1 tempest-GroupsTest-1839460627 None] Delete group completed successfully. Nov 02 11:46:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] GroupSnapshot a752b595-2579-4fc5-98c8-aff2c8956971: creating. Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Group snapshot a752b595-2579-4fc5-98c8-aff2c8956971: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Creating offline snapshot 7408688e-80f5-4806-bb85-ce2c11b0244c of volume a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f622b01-30df-4fcb-b766-84fb13d383dc]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:39 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 Nov 02 11:46:39 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:40 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595" returned: 0 in 0.892s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:40 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c 1G Nov 02 11:46:40 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3889b895-f4f5-419d-b9ce-6f7ee0930488 tempest-GroupsTest-1839460627 None] Group tempest-GroupsTest-Group-1485953544: creating Nov 02 11:46:41 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c 1G" returned: 0 in 1.098s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3889b895-f4f5-419d-b9ce-6f7ee0930488 tempest-GroupsTest-1839460627 None] Group tempest-GroupsTest-Group-1485953544: created successfully Nov 02 11:46:41 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c Nov 02 11:46:41 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3889b895-f4f5-419d-b9ce-6f7ee0930488 tempest-GroupsTest-1839460627 None] Create group completed successfully. Nov 02 11:46:41 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c" returned: 0 in 0.537s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:41 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:46:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:42 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c Nov 02 11:46:42 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:42 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:42 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.info Nov 02 11:46:42 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:43 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.info" returned: 0 in 0.739s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:43 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:46:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:43 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.info Nov 02 11:46:43 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:43 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.info" returned: 0 in 0.580s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.618s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:43 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Flow 'volume_create_manager' (85cdaa16-7150-47be-b8a5-0637493bcb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2851296-67ca-4b74-9962-04258c98f287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2851296-67ca-4b74-9962-04258c98f287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-407897058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b03b604-9847-46a2-85db-e69c82eb1571,host='devstack@QuobyteHD#QuobyteHD',id=d90459ce-6138-4fc3-9ce6-53cb850fc603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47900887f245018c22c100f68bef50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:44Z,use_quota=True,user_id='fcf3ae7cc917403183c3894dc4ffb59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3700b9c-4c57-40d1-8fd4-1f06035b5000),volume_type_id=f3700b9c-4c57-40d1-8fd4-1f06035b5000)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26e255e-8b39-4f23-b43e-7db76d8a5445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26e255e-8b39-4f23-b43e-7db76d8a5445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a897fc18-7201-425a-a9af-fda97c450b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a897fc18-7201-425a-a9af-fda97c450b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90459ce-6138-4fc3-9ce6-53cb850fc603', 'volume_name': 'volume-d90459ce-6138-4fc3-9ce6-53cb850fc603', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60436ed4-cc8e-4c8d-8d9c-6b8b8f975c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60436ed4-cc8e-4c8d-8d9c-6b8b8f975c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4285c82f-3cb0-436f-ba0f-89f176535893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Volume d90459ce-6138-4fc3-9ce6-53cb850fc603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90459ce-6138-4fc3-9ce6-53cb850fc603', 'volume_size': 1} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b03b604-9847-46a2-85db-e69c82eb1571,created_at=2026-11-02T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-407897058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b03b604-9847-46a2-85db-e69c82eb1571,host='devstack@QuobyteHD#QuobyteHD',id=d90459ce-6138-4fc3-9ce6-53cb850fc603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47900887f245018c22c100f68bef50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:44Z,use_quota=True,user_id='fcf3ae7cc917403183c3894dc4ffb59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3700b9c-4c57-40d1-8fd4-1f06035b5000),volume_type_id=f3700b9c-4c57-40d1-8fd4-1f06035b5000)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Creating volume d90459ce-6138-4fc3-9ce6-53cb850fc603 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:44 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 1073741824 Nov 02 11:46:44 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e5c89823-d45b-41c9-8ede-4f21c9819b7d tempest-GroupSnapshotsV319Test-324324584 None] group_snapshot a752b595-2579-4fc5-98c8-aff2c8956971: created successfully Nov 02 11:46:44 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 1073741824" returned: 0 in 0.748s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:44 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 Nov 02 11:46:44 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:45 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603" returned: 0 in 0.584s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4285c82f-3cb0-436f-ba0f-89f176535893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90459ce-6138-4fc3-9ce6-53cb850fc603', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab197d-1087-486d-a73e-776549c24eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Volume volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 (d90459ce-6138-4fc3-9ce6-53cb850fc603): created successfully Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab197d-1087-486d-a73e-776549c24eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Flow 'volume_create_manager' (85cdaa16-7150-47be-b8a5-0637493bcb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-502e24a2-7e8a-4b7f-9e03-60b9beafc52a tempest-GroupsTest-1839460627 None] Created volume successfully. Nov 02 11:46:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] group_snapshot a752b595-2579-4fc5-98c8-aff2c8956971: deleting Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] group_snapshot a752b595-2579-4fc5-98c8-aff2c8956971: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Acquiring lock "cinder-quobyte-a3eba549-1867-4384-8e5d-66bf1bd2e595" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Lock "cinder-quobyte-a3eba549-1867-4384-8e5d-66bf1bd2e595" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Acquiring lock "cinder-quobyte-7408688e-80f5-4806-bb85-ce2c11b0244c" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Lock "cinder-quobyte-7408688e-80f5-4806-bb85-ce2c11b0244c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Deleting offline snapshot 7408688e-80f5-4806-bb85-ce2c11b0244c of volume a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] snapshot_file for this snap is: volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7d9713-76a6-4f93-adac-ecad9c2ed47d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:46 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c Nov 02 11:46:46 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:46 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c" returned: 0 in 0.622s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3eba549-1867-4384-8e5d-66bf1bd2e595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ba600e-56ef-4a2a-8813-6203ce14df22]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:47 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 Nov 02 11:46:47 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-8392c30e-fccd-49e1-82fb-1e32592ea41a req-d598c606-66ef-41c9-b7c4-fd55ae152ba4 tempest-ServerActionsTestOtherA-217023053 None] Terminate volume connection completed successfully. Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-8392c30e-fccd-49e1-82fb-1e32592ea41a req-d598c606-66ef-41c9-b7c4-fd55ae152ba4 tempest-ServerActionsTestOtherA-217023053 None] Deleting attachment b3b8b397-ca83-4407-9071-9f612a3bab32. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:46:47 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Flow 'volume_create_manager' (60b6ab07-5b99-4c3d-9046-54fe8dbd5180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b0b0a6-68c4-40fb-b5ef-676db0eb1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595" returned: 0 in 1.000s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:47 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c Nov 02 11:46:47 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b0b0a6-68c4-40fb-b5ef-676db0eb1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1850162891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b03b604-9847-46a2-85db-e69c82eb1571,host='devstack@QuobyteHD#QuobyteHD',id=a19cbb86-80d0-4d2f-8574-5e8e10277429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47900887f245018c22c100f68bef50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:48Z,use_quota=True,user_id='fcf3ae7cc917403183c3894dc4ffb59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3700b9c-4c57-40d1-8fd4-1f06035b5000),volume_type_id=f3700b9c-4c57-40d1-8fd4-1f06035b5000)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6160818-ca79-459e-8526-bc24748a1450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6160818-ca79-459e-8526-bc24748a1450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863d50bb-6746-4c2e-99c0-97d75d964d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863d50bb-6746-4c2e-99c0-97d75d964d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19cbb86-80d0-4d2f-8574-5e8e10277429', 'volume_name': 'volume-a19cbb86-80d0-4d2f-8574-5e8e10277429', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cfbfb1-7b95-4fee-95d5-8fc284ac45d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cfbfb1-7b95-4fee-95d5-8fc284ac45d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e64a026-59d3-405a-ae91-70c379e511a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Volume a19cbb86-80d0-4d2f-8574-5e8e10277429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19cbb86-80d0-4d2f-8574-5e8e10277429', 'volume_size': 1} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b03b604-9847-46a2-85db-e69c82eb1571,created_at=2026-11-02T10:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1850162891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b03b604-9847-46a2-85db-e69c82eb1571,host='devstack@QuobyteHD#QuobyteHD',id=a19cbb86-80d0-4d2f-8574-5e8e10277429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b47900887f245018c22c100f68bef50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:46:48Z,use_quota=True,user_id='fcf3ae7cc917403183c3894dc4ffb59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3700b9c-4c57-40d1-8fd4-1f06035b5000),volume_type_id=f3700b9c-4c57-40d1-8fd4-1f06035b5000)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Creating volume a19cbb86-80d0-4d2f-8574-5e8e10277429 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:46:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:48 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 1073741824 Nov 02 11:46:48 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:48 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c" returned: 0 in 0.607s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:48 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c Nov 02 11:46:48 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:48 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 1073741824" returned: 0 in 0.682s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:48 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 Nov 02 11:46:48 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:48 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595.7408688e-80f5-4806-bb85-ce2c11b0244c" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Lock "cinder-quobyte-7408688e-80f5-4806-bb85-ce2c11b0244c" released by "_delete_snapshot" :: held 2.860s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Lock "cinder-quobyte-a3eba549-1867-4384-8e5d-66bf1bd2e595" released by "delete_snapshot" :: held 2.908s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:48 devstack cinder-volume[86846]: WARNING cinder.quota [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-185185020 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-185185020, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:48 devstack cinder-volume[86846]: WARNING cinder.quota [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-185185020 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-185185020, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] Created reservations ['2a06998f-4fb1-4b8f-9a55-72e03a56f16d', '91e1161e-d026-4c04-a3f2-7e9e4743ba48', 'dc23422b-e746-44f1-8899-35e1c1687d9c', '66763bb8-8188-4441-b2a8-d5d444f28130'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-af881e8a-0c78-4a32-826c-456c8da53fef tempest-GroupSnapshotsV319Test-324324584 None] group_snapshot a752b595-2579-4fc5-98c8-aff2c8956971: deleted successfully Nov 02 11:46:49 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e64a026-59d3-405a-ae91-70c379e511a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19cbb86-80d0-4d2f-8574-5e8e10277429', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08640d6e-762f-467b-b039-52997fe55193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:46:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Volume volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 (a19cbb86-80d0-4d2f-8574-5e8e10277429): created successfully Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08640d6e-762f-467b-b039-52997fe55193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Flow 'volume_create_manager' (60b6ab07-5b99-4c3d-9046-54fe8dbd5180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:46:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d7922e9e-790c-45bd-88cc-7de2b31f9e0c tempest-GroupsTest-1839460627 None] Created volume successfully. Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-8392c30e-fccd-49e1-82fb-1e32592ea41a req-79e63f98-e704-40b6-b18a-dd28fdebb934 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-8392c30e-fccd-49e1-82fb-1e32592ea41a req-79e63f98-e704-40b6-b18a-dd28fdebb934 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-8392c30e-fccd-49e1-82fb-1e32592ea41a req-79e63f98-e704-40b6-b18a-dd28fdebb934 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-8392c30e-fccd-49e1-82fb-1e32592ea41a req-79e63f98-e704-40b6-b18a-dd28fdebb934 tempest-ServerActionsTestOtherA-217023053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97c584b1-25eb-4b34-8b58-4359b34d0415', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:46:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-8392c30e-fccd-49e1-82fb-1e32592ea41a req-79e63f98-e704-40b6-b18a-dd28fdebb934 tempest-ServerActionsTestOtherA-217023053 None] attachment_update completed successfully. Nov 02 11:46:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Acquiring lock "cinder-quobyte-a3eba549-1867-4384-8e5d-66bf1bd2e595" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Lock "cinder-quobyte-a3eba549-1867-4384-8e5d-66bf1bd2e595" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb6e48-cdb3-4a12-83f7-f1dc2a5e7ac9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:50 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 Nov 02 11:46:50 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2320ff80-fc53-4f28-b093-d0844a4e7ec3 tempest-GroupsTest-1839460627 None] Update group completed successfully. Nov 02 11:46:51 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595" returned: 0 in 0.714s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:51 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595 Nov 02 11:46:51 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:51 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a3eba549-1867-4384-8e5d-66bf1bd2e595" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Lock "cinder-quobyte-a3eba549-1867-4384-8e5d-66bf1bd2e595" released by "delete_volume" :: held 1.126s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Created reservations ['a85cf6c6-1602-4d8b-a0b1-2270b6b807b1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:51 devstack cinder-volume[86846]: WARNING cinder.quota [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-185185020 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-185185020, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Created reservations ['b40ea75c-e54e-440e-8f78-5bae468e3f19', '43279c0d-c2a6-4ecd-8ed9-f1f7964787aa', 'e0826cb8-587f-4459-bd14-55e78e369a85', '83414a5e-1f8f-49d1-b3f5-6d17e6fc8a61'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:51 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:51 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:51 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.261s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:51 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c6b15cd4-69e7-4a9a-adf7-936b2daa2860 tempest-GroupSnapshotsV319Test-324324584 None] Delete group completed successfully. Nov 02 11:46:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-abc4b022-a56d-4941-aea5-85b72cfa1140 tempest-GroupsTest-1839460627 None] Update group completed successfully. Nov 02 11:46:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Acquiring lock "cinder-quobyte-a19cbb86-80d0-4d2f-8574-5e8e10277429" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Lock "cinder-quobyte-a19cbb86-80d0-4d2f-8574-5e8e10277429" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fff1c97-2855-4780-a4b3-50aecbc37d31]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:54 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 Nov 02 11:46:54 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:55 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429" returned: 0 in 0.633s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:55 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429 Nov 02 11:46:55 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:55 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a19cbb86-80d0-4d2f-8574-5e8e10277429" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Lock "cinder-quobyte-a19cbb86-80d0-4d2f-8574-5e8e10277429" released by "delete_volume" :: held 1.177s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Acquiring lock "cinder-quobyte-d90459ce-6138-4fc3-9ce6-53cb850fc603" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Lock "cinder-quobyte-d90459ce-6138-4fc3-9ce6-53cb850fc603" acquired by "delete_volume" :: waited 0.056s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f3254-ad67-4593-98fb-c19c7232ae7c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:46:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:55 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 Nov 02 11:46:55 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:56 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603" returned: 0 in 0.692s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:56 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603 Nov 02 11:46:56 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:56 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d90459ce-6138-4fc3-9ce6-53cb850fc603" returned: 0 in 0.329s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Lock "cinder-quobyte-d90459ce-6138-4fc3-9ce6-53cb850fc603" released by "delete_volume" :: held 1.095s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:46:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Created reservations ['61bac13e-da2d-463b-986f-a85bfd725d7c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:56 devstack cinder-volume[86846]: WARNING cinder.quota [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-678984789 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-678984789, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:56 devstack cinder-volume[86846]: WARNING cinder.quota [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-678984789 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-678984789, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:46:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Created reservations ['2e321095-d44f-4cab-8194-4653b5dad3dc', '97273268-0957-48be-b0c5-5bd8b9a9cfdb', '6890939b-7c3e-4323-a1ae-d7899a200d25', '51e83cf8-4376-4da7-8f6c-26d3c67b5e63'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Created reservations ['5c980825-de76-49de-86a6-df2a5279e2a0', 'e2131869-b7b0-49fd-a709-58c8eabb9c97', '0a776ae9-63d3-4a8e-ac95-4aa35252ea4d', '1730edca-c959-4b25-b8b2-1b260bb9fc8e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:46:57 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:46:57 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:46:57 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:46:57 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:46:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-86a1e4c9-f9e9-49f8-ab47-f4172227c5f6 tempest-GroupsTest-1839460627 None] Delete group completed successfully. Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Flow 'volume_create_manager' (8139237e-a8c2-46c3-99e7-01311fd614a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976c0013-6d9d-4f04-a794-710d17c19432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976c0013-6d9d-4f04-a794-710d17c19432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-824467127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7a4d63-088a-48ac-9486-0134e6da64d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28bc9d5b5324c33874e9b0bb580e62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:01Z,use_quota=True,user_id='6670090b4c394871921fc41b2b2c43e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fcba54-9abb-4f40-98fc-960f63417aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fcba54-9abb-4f40-98fc-960f63417aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3b508c-8b0c-42b7-b8d0-d90aed25bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3b508c-8b0c-42b7-b8d0-d90aed25bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7a4d63-088a-48ac-9486-0134e6da64d4', 'volume_name': 'volume-5c7a4d63-088a-48ac-9486-0134e6da64d4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371215c1-167c-492d-832b-6c88b3ebccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371215c1-167c-492d-832b-6c88b3ebccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d8a81f-bb86-4752-b29d-1c1c28245e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Volume 5c7a4d63-088a-48ac-9486-0134e6da64d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7a4d63-088a-48ac-9486-0134e6da64d4', 'volume_size': 1} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-824467127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7a4d63-088a-48ac-9486-0134e6da64d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28bc9d5b5324c33874e9b0bb580e62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:01Z,use_quota=True,user_id='6670090b4c394871921fc41b2b2c43e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Creating volume 5c7a4d63-088a-48ac-9486-0134e6da64d4 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:01 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:47:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:01 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 1073741824 Nov 02 11:47:01 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:02 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 1073741824" returned: 0 in 0.615s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:02 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 Nov 02 11:47:02 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:02 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d8a81f-bb86-4752-b29d-1c1c28245e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7a4d63-088a-48ac-9486-0134e6da64d4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5d0426-f1d9-4cb7-9862-dd19f41f21a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Volume volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 (5c7a4d63-088a-48ac-9486-0134e6da64d4): created successfully Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5d0426-f1d9-4cb7-9862-dd19f41f21a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Flow 'volume_create_manager' (8139237e-a8c2-46c3-99e7-01311fd614a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d3131b33-fad4-42eb-a31a-8d0cc7cfa7e3 tempest-AttachVolumeNegativeTest-1244714756 None] Created volume successfully. Nov 02 11:47:05 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=122,cinder:DELETE=6,cinder:SELECT=138,cinder:INSERT=37 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:47:05 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=134,cinder:UPDATE=137,cinder:DELETE=9,cinder:INSERT=31 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:47:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4ff6f71b-52d3-4f3a-ab3c-c8ca8ed480ab req-86ef6647-0eb7-4092-bdbb-3764470f52bf tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4ff6f71b-52d3-4f3a-ab3c-c8ca8ed480ab req-86ef6647-0eb7-4092-bdbb-3764470f52bf tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4ff6f71b-52d3-4f3a-ab3c-c8ca8ed480ab req-86ef6647-0eb7-4092-bdbb-3764470f52bf tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-4ff6f71b-52d3-4f3a-ab3c-c8ca8ed480ab req-86ef6647-0eb7-4092-bdbb-3764470f52bf tempest-AttachVolumeNegativeTest-1244714756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-5c7a4d63-088a-48ac-9486-0134e6da64d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '892d5403-6ca2-4212-86d9-468602b6353f', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:47:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-4ff6f71b-52d3-4f3a-ab3c-c8ca8ed480ab req-86ef6647-0eb7-4092-bdbb-3764470f52bf tempest-AttachVolumeNegativeTest-1244714756 None] attachment_update completed successfully. Nov 02 11:47:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1f8499ad-ffec-4ebd-896c-c9d5123886e5 tempest-GroupsV314Test-1098967958 None] Group tempest-GroupsV314Test-Group-887047781: creating Nov 02 11:47:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1f8499ad-ffec-4ebd-896c-c9d5123886e5 tempest-GroupsV314Test-1098967958 None] Group tempest-GroupsV314Test-Group-887047781: created successfully Nov 02 11:47:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1f8499ad-ffec-4ebd-896c-c9d5123886e5 tempest-GroupsV314Test-1098967958 None] Create group completed successfully. Nov 02 11:47:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-d562f4ab-dab4-4598-8c8f-5067ea973e55 req-b9edb0ff-17bf-40a3-a0f1-02b298706aff tempest-AttachVolumeNegativeTest-1244714756 None] Terminate volume connection completed successfully. Nov 02 11:47:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-d562f4ab-dab4-4598-8c8f-5067ea973e55 req-b9edb0ff-17bf-40a3-a0f1-02b298706aff tempest-AttachVolumeNegativeTest-1244714756 None] Deleting attachment 892d5403-6ca2-4212-86d9-468602b6353f. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Flow 'volume_create_manager' (41bbece9-dde3-42a6-9de8-a4bf8ea761b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4827bad9-796b-45a3-9977-06e65cbc70b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4827bad9-796b-45a3-9977-06e65cbc70b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833482977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15b47e1d-3b44-43dc-80e2-b926047d00a1,host='devstack@QuobyteHD#QuobyteHD',id=fbff6a90-27f4-4507-b5df-5c5ae7dcc80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d364fd7b632c4e66947799ce126caede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:09Z,use_quota=True,user_id='35f45f40f544401fbb5f5a97860f62d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2553d233-4ad6-4c7f-9294-25cbdb490f19),volume_type_id=2553d233-4ad6-4c7f-9294-25cbdb490f19)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256468ee-b3cf-462e-8ccc-92ae848925d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256468ee-b3cf-462e-8ccc-92ae848925d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e8dc36-a568-40c1-b203-dfe0f15e5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e8dc36-a568-40c1-b203-dfe0f15e5c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbff6a90-27f4-4507-b5df-5c5ae7dcc80a', 'volume_name': 'volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3405dd-b951-4475-9dc1-21466277ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3405dd-b951-4475-9dc1-21466277ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2859a5ea-cee0-40e1-9d07-a7c8d5b72a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Volume fbff6a90-27f4-4507-b5df-5c5ae7dcc80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a', 'volume_size': 1} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15b47e1d-3b44-43dc-80e2-b926047d00a1,created_at=2026-11-02T10:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833482977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15b47e1d-3b44-43dc-80e2-b926047d00a1,host='devstack@QuobyteHD#QuobyteHD',id=fbff6a90-27f4-4507-b5df-5c5ae7dcc80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d364fd7b632c4e66947799ce126caede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:09Z,use_quota=True,user_id='35f45f40f544401fbb5f5a97860f62d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2553d233-4ad6-4c7f-9294-25cbdb490f19),volume_type_id=2553d233-4ad6-4c7f-9294-25cbdb490f19)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Creating volume fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:09 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:47:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:09 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a 1073741824 Nov 02 11:47:09 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:10 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a 1073741824" returned: 0 in 0.959s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:10 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a Nov 02 11:47:10 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:10 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" returned: 0 in 0.459s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2859a5ea-cee0-40e1-9d07-a7c8d5b72a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61cf9b7-dd3b-403c-9041-121437a90d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Volume volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a (fbff6a90-27f4-4507-b5df-5c5ae7dcc80a): created successfully Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61cf9b7-dd3b-403c-9041-121437a90d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Flow 'volume_create_manager' (41bbece9-dde3-42a6-9de8-a4bf8ea761b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-00b023df-0f2c-4faf-9eb4-4a590b4319f2 tempest-GroupsV314Test-1098967958 None] Created volume successfully. Nov 02 11:47:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Cloning volume fbff6a90-27f4-4507-b5df-5c5ae7dcc80a to volume ea15f88f-69b7-4f8f-acaf-02e8b2738a37 Nov 02 11:47:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Creating offline snapshot 94d9954b-e1cf-4622-a63b-fe010dc877fc of volume fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:47:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[85040979-f5ed-4393-b20f-93ff07ff3730]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:12 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a Nov 02 11:47:12 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:13 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" returned: 0 in 0.559s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:13 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc 1G Nov 02 11:47:13 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "cinder-5c7a4d63-088a-48ac-9486-0134e6da64d4-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-5c7a4d63-088a-48ac-9486-0134e6da64d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:13 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc 1G" returned: 0 in 0.543s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "cinder-quobyte-5c7a4d63-088a-48ac-9486-0134e6da64d4" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:13 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc Nov 02 11:47:13 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-quobyte-5c7a4d63-088a-48ac-9486-0134e6da64d4" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0333f156-e1af-4eb6-b511-8449423af3ef]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:13 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 Nov 02 11:47:13 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:14 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:14 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc Nov 02 11:47:14 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:14 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:14 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4 Nov 02 11:47:14 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:14 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:14 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.info Nov 02 11:47:14 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:14 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5c7a4d63-088a-48ac-9486-0134e6da64d4" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-quobyte-5c7a4d63-088a-48ac-9486-0134e6da64d4" released by "delete_volume" :: held 0.797s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Created reservations ['e59a9ee7-ef2f-4f1c-a498-8b2190158036', 'a6f0a9b9-7e2b-43fe-ad4b-54f7b31e4276', '2ed1cfa9-06a8-4f52-b6be-eaf885f03613', '5e7bf645-879e-4e76-9705-da40d37d710d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:14 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.info" returned: 0 in 0.268s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:14 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.info Nov 02 11:47:14 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:14 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:14 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:14 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.info" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Acquiring lock "cinder-quobyte-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "cinder-49b10ed1-510d-4b79-9f19-cf1122fbf928-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] snapshot: 94d9954b-e1cf-4622-a63b-fe010dc877fc, volume: ea15f88f-69b7-4f8f-acaf-02e8b2738a37, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:15 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-49b10ed1-510d-4b79-9f19-cf1122fbf928-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Deleted volume successfully. Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6e94c6-df56-46a8-8be1-f28f40ab81d7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e9946162-21f2-4fd6-90b9-81f7e334809a tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-5c7a4d63-088a-48ac-9486-0134e6da64d4-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "cinder-quobyte-49b10ed1-510d-4b79-9f19-cf1122fbf928" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-quobyte-49b10ed1-510d-4b79-9f19-cf1122fbf928" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22f424c-7c9c-4b42-a283-394fa8967559]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:15 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc Nov 02 11:47:15 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:15 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 Nov 02 11:47:15 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:15 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc94fb7-73b2-491f-985d-d81621938187]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:15 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:15 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a Nov 02 11:47:15 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:15 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928 Nov 02 11:47:15 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:15 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:15 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" returned: 0 in 0.401s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-49b10ed1-510d-4b79-9f19-cf1122fbf928" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:15 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 Nov 02 11:47:15 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-quobyte-49b10ed1-510d-4b79-9f19-cf1122fbf928" released by "delete_volume" :: held 0.801s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:15 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Created reservations ['707f8580-4a55-497a-99a2-398e6066e5b0', '2f77d84f-abf4-434f-812b-2bf21a810879', 'a28207e1-224e-4f13-a0c6-55c4493e9bd6', '4e2a1c67-f949-44de-9d19-474f6e6d33ee'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:16 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:16 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "cinder-c7363a93-bd6b-4f76-9b24-f0d4c57ab198-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-c7363a93-bd6b-4f76-9b24-f0d4c57ab198-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "cinder-quobyte-c7363a93-bd6b-4f76-9b24-f0d4c57ab198" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:16 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Deleted volume successfully. Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-quobyte-c7363a93-bd6b-4f76-9b24-f0d4c57ab198" acquired by "delete_volume" :: waited 0.058s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-601e5c1f-fcb3-4fbe-b9e3-39ed375966c1 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-49b10ed1-510d-4b79-9f19-cf1122fbf928-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[32080d24-8598-4480-9a77-ffa37364b59b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:16 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 Nov 02 11:47:16 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:17 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198" returned: 0 in 0.798s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:17 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198 Nov 02 11:47:17 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:17 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7363a93-bd6b-4f76-9b24-f0d4c57ab198" returned: 0 in 0.532s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-quobyte-c7363a93-bd6b-4f76-9b24-f0d4c57ab198" released by "delete_volume" :: held 1.502s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Created reservations ['2490ca9a-0939-47cd-b3b9-37a103203cba', 'ae0d7d6a-e9b7-4fc8-bf52-0ed1c6b6bb3d', '724c9de0-e8cb-42f5-b9aa-e88d83a615f8', '20df6af7-d4d2-4bce-98ac-247e7f30e1b5'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:18 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:18 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:18 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.637s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:19 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:19 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Deleted volume successfully. Nov 02 11:47:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a42f6027-22a8-4c99-9a28-2827686cf017 tempest-AttachVolumeNegativeTest-1244714756 None] Lock "cinder-c7363a93-bd6b-4f76-9b24-f0d4c57ab198-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:19 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.760s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:47:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:47:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:47:25 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" returned: 0 in 9.193s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a, size 1024.00 MB, duration 9.19 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:47:25 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Converted 1024.00 MB image at 111.37 MB/s Nov 02 11:47:25 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:25 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 Nov 02 11:47:25 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:25 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" released by "_copy_volume_from_snapshot" :: held 10.375s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Acquiring lock "cinder-quobyte-94d9954b-e1cf-4622-a63b-fe010dc877fc" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-94d9954b-e1cf-4622-a63b-fe010dc877fc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Deleting offline snapshot 94d9954b-e1cf-4622-a63b-fe010dc877fc of volume fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] snapshot_file for this snap is: volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1717d37f-33f4-4e18-bfd6-0719f5e059c4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:25 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc Nov 02 11:47:25 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:25 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc" returned: 0 in 0.382s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905fe5b-20f9-440f-96c0-5b3941654c09]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:25 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a Nov 02 11:47:25 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:26 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" returned: 0 in 0.622s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:26 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc Nov 02 11:47:26 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:26 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:26 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc Nov 02 11:47:26 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:27 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a.94d9954b-e1cf-4622-a63b-fe010dc877fc" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-94d9954b-e1cf-4622-a63b-fe010dc877fc" released by "_delete_snapshot" :: held 1.816s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.799s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cac5c3a8-8407-4ca1-98df-54e0eb1e884a tempest-GroupsV314Test-1098967958 None] Create group from source-group-15b47e1d-3b44-43dc-80e2-b926047d00a1 completed successfully. Nov 02 11:47:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Acquiring lock "cinder-quobyte-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad10c6f1-a29e-47b4-af74-75aa339a4292]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:28 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 Nov 02 11:47:28 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Flow 'volume_create_manager' (fcbe78b8-7976-4bcd-88a6-88e2dfd38a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a286ca-7987-4ed0-8d99-eeb66a1b7822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a286ca-7987-4ed0-8d99-eeb66a1b7822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-850556425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df82731-5f98-4115-81d0-992115ea922c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ab8497b2dd47379f368bada9171b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:28Z,use_quota=True,user_id='e45fa70033174134a4aa6e824359e9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9929de4c-310d-4b23-ba19-27a18e1826fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9929de4c-310d-4b23-ba19-27a18e1826fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f922086-553f-4c11-9195-aa947204eacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f922086-553f-4c11-9195-aa947204eacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df82731-5f98-4115-81d0-992115ea922c', 'volume_name': 'volume-8df82731-5f98-4115-81d0-992115ea922c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4196a201-52f5-46e7-a4be-882aaf1f6b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4196a201-52f5-46e7-a4be-882aaf1f6b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6590e4fb-5396-4885-8dc7-8c595e928481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Volume 8df82731-5f98-4115-81d0-992115ea922c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df82731-5f98-4115-81d0-992115ea922c', 'volume_size': 1} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-850556425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df82731-5f98-4115-81d0-992115ea922c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ab8497b2dd47379f368bada9171b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:28Z,use_quota=True,user_id='e45fa70033174134a4aa6e824359e9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Creating volume 8df82731-5f98-4115-81d0-992115ea922c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:28 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c 1073741824 Nov 02 11:47:28 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:28 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" returned: 0 in 0.475s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:28 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37 Nov 02 11:47:28 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:28 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-ea15f88f-69b7-4f8f-acaf-02e8b2738a37" released by "delete_volume" :: held 0.820s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Created reservations ['31f95d9a-1a0b-4148-bcdd-0c73803d62db'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:28 devstack cinder-volume[86846]: WARNING cinder.quota [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1403535515 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1403535515, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:47:28 devstack cinder-volume[86846]: WARNING cinder.quota [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1403535515 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1403535515, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:47:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Created reservations ['adb74dd2-3d28-4058-b010-1a0352dee00d', 'cbce6a29-9c24-49ea-98c3-a6041b9049ef', 'b3443120-4c0f-4755-80d8-c42b5e2af856', 'ba384dcd-e31c-4fda-8886-700c0e39a1c0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:28 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c 1073741824" returned: 0 in 0.546s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:29 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c Nov 02 11:47:29 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:29 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:29 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:29 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:29 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c6c60c42-13ea-496d-af4c-69603d51cc87 tempest-GroupsV314Test-1098967958 None] Delete group completed successfully. Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6590e4fb-5396-4885-8dc7-8c595e928481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df82731-5f98-4115-81d0-992115ea922c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48e9615-7f65-447b-a918-bd8daf1e5d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Volume volume-8df82731-5f98-4115-81d0-992115ea922c (8df82731-5f98-4115-81d0-992115ea922c): created successfully Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48e9615-7f65-447b-a918-bd8daf1e5d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Flow 'volume_create_manager' (fcbe78b8-7976-4bcd-88a6-88e2dfd38a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e7e9b6f0-0db3-4fa3-906e-5782def9132a tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Created volume successfully. Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Acquiring lock "cinder-quobyte-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[181ac4be-7c9f-404c-8d89-98fd1db4243d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:29 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a Nov 02 11:47:29 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:30 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:30 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a Nov 02 11:47:30 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:30 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Lock "cinder-quobyte-fbff6a90-27f4-4507-b5df-5c5ae7dcc80a" released by "delete_volume" :: held 0.732s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Created reservations ['19ee0e66-96b5-46b2-89fd-fbdd11e17d58'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Created reservations ['ae1110cc-e50b-437c-98c3-bb881dfbd1f2', 'eb3c55b2-c4d0-4a0e-8957-187de007bfe6', 'c2e04914-a61a-4770-b9ce-b4ddaea47a4e', '7d061910-fc01-451e-b1f7-af195e7ba573'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:30 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:30 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:30 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4fe2381d-5aea-44b9-b6bc-43868435f77c tempest-GroupsV314Test-1098967958 None] Delete group completed successfully. Nov 02 11:47:30 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Flow 'volume_create_manager' (3b9e0f41-63e2-46bc-9d89-7cc061b8e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9b9b3-d411-41cb-9dc9-e3dc7eaede7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe9b9b3-d411-41cb-9dc9-e3dc7eaede7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-166434016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f212657-0fc9-47d9-9982-b6c70a4c6b64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0bab77859904fb194d4ea89c9fc6a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:31Z,use_quota=True,user_id='cf8b705a629d4bac9ed5daf0e728daf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2196e5-85ac-4dac-90a2-8d2a3c0c66fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2196e5-85ac-4dac-90a2-8d2a3c0c66fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdb853a-de53-42fa-be3d-10a045d452d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdb853a-de53-42fa-be3d-10a045d452d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f212657-0fc9-47d9-9982-b6c70a4c6b64', 'volume_name': 'volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b77d00-dad0-4883-aaa7-0e963ba330cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b77d00-dad0-4883-aaa7-0e963ba330cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47621c51-912c-4dc8-ae2f-2c2532a212a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Volume 3f212657-0fc9-47d9-9982-b6c70a4c6b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64', 'volume_size': 1} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-166434016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f212657-0fc9-47d9-9982-b6c70a4c6b64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0bab77859904fb194d4ea89c9fc6a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:31Z,use_quota=True,user_id='cf8b705a629d4bac9ed5daf0e728daf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Creating volume 3f212657-0fc9-47d9-9982-b6c70a4c6b64 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:31 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 1073741824 Nov 02 11:47:31 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:31 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 1073741824" returned: 0 in 0.507s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:31 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 Nov 02 11:47:31 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Acquiring lock "cinder-8df82731-5f98-4115-81d0-992115ea922c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "cinder-8df82731-5f98-4115-81d0-992115ea922c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Acquiring lock "cinder-quobyte-8df82731-5f98-4115-81d0-992115ea922c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "cinder-quobyte-8df82731-5f98-4115-81d0-992115ea922c" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b699408-411a-4c4e-a59f-596359be65ee]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:31 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47621c51-912c-4dc8-ae2f-2c2532a212a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47f3b71-bd0b-47f2-9ce9-9f7ba861ada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Volume volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 (3f212657-0fc9-47d9-9982-b6c70a4c6b64): created successfully Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47f3b71-bd0b-47f2-9ce9-9f7ba861ada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Flow 'volume_create_manager' (3b9e0f41-63e2-46bc-9d89-7cc061b8e26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-424452de-86ad-4b9d-8a58-609bab87f692 req-66f608e3-73d8-480b-b958-319d20c63d5c tempest-VolumesGetTestJSON-1651294733 None] Created volume successfully. Nov 02 11:47:32 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c Nov 02 11:47:32 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:32 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c" returned: 0 in 0.411s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:32 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c Nov 02 11:47:32 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:32 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8df82731-5f98-4115-81d0-992115ea922c" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "cinder-quobyte-8df82731-5f98-4115-81d0-992115ea922c" released by "delete_volume" :: held 0.777s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Created reservations ['adb340e9-c658-492d-857f-1a8984843d4c', '1995fcf5-2208-47e1-8a9b-ed9f357dbd14', 'a8d4bea0-f3bd-469d-959f-a0fb676bb76b', '253ac197-c199-4901-a6ee-e61ac6c9bbd1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:32 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:32 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:33 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.269s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Deleted volume successfully. Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c02eb7fe-87f6-4b1f-8fbe-cfccd9bc821c tempest-VolumeQuotasNegativeTestJSON-2110286039 None] Lock "cinder-8df82731-5f98-4115-81d0-992115ea922c-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Acquiring lock "cinder-3f212657-0fc9-47d9-9982-b6c70a4c6b64-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Lock "cinder-3f212657-0fc9-47d9-9982-b6c70a4c6b64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Acquiring lock "cinder-quobyte-3f212657-0fc9-47d9-9982-b6c70a4c6b64" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Lock "cinder-quobyte-3f212657-0fc9-47d9-9982-b6c70a4c6b64" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed60d448-2527-4fc5-bb3b-3cad847c4fa1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:34 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 Nov 02 11:47:34 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:34 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:34 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64 Nov 02 11:47:34 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:34 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f212657-0fc9-47d9-9982-b6c70a4c6b64" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Lock "cinder-quobyte-3f212657-0fc9-47d9-9982-b6c70a4c6b64" released by "delete_volume" :: held 0.864s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG cinder.quota [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Created reservations ['f8bd5412-cc5d-4de6-9084-16bc27e9dae5', '072531e5-d5d2-473c-959d-174efe6300d6', '2ab5bc29-fd37-4c42-934e-87bd97fd18c2', 'c7174799-229f-45a5-b0af-ef3253514b52'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:34 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:34 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:35 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.644s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:35 devstack cinder-volume[86846]: DEBUG cinder.manager [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Deleted volume successfully. Nov 02 11:47:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-90e5cb8e-4dba-4b81-9e3d-147b81cecaab req-7967d877-67bb-4701-abb4-ec3eebfe167d tempest-VolumesGetTestJSON-1651294733 None] Lock "cinder-3f212657-0fc9-47d9-9982-b6c70a4c6b64-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a272f02-de5a-472a-8971-ab5726c2ccb3 tempest-ServerActionsTestOtherA-217023053 None] Terminate volume connection completed successfully. Nov 02 11:47:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a272f02-de5a-472a-8971-ab5726c2ccb3 tempest-ServerActionsTestOtherA-217023053 None] Deleting attachment 97c584b1-25eb-4b34-8b58-4359b34d0415. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:47:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "cinder-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "cinder-quobyte-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-quobyte-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17f8a3c-00d5-4086-8ebd-8773f9e7ddb5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:37 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 Nov 02 11:47:37 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:38 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985" returned: 0 in 0.707s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:38 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985 Nov 02 11:47:38 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "cinder-3e1680b0-ba94-4a52-9049-665d60eb79d3-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-3e1680b0-ba94-4a52-9049-665d60eb79d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "cinder-quobyte-3e1680b0-ba94-4a52-9049-665d60eb79d3" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-quobyte-3e1680b0-ba94-4a52-9049-665d60eb79d3" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:38 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-quobyte-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985" released by "delete_volume" :: held 1.127s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a90ba-1e9d-46b3-a365-8efe5ee09c02]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.quota [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Created reservations ['1b1fa230-39f5-4ae1-9807-25e069459086', '8c8bc986-8b4e-4d45-9dd6-14d261659e4c', '0884cc5b-b25e-4f6f-937f-565de32705e7', '250c4ae7-b11c-4a77-a42f-07610459ff00'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:38 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 Nov 02 11:47:38 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:38 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:38 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:39 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3" returned: 0 in 0.547s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:39 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG cinder.manager [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Deleted volume successfully. Nov 02 11:47:39 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3 Nov 02 11:47:39 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-7325e1e1-7109-43ee-aef0-fb0e9d5e06c9 req-7a34a56e-9640-482d-94da-f04483bf23e3 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-2e6e1f0a-76d6-4363-9ea7-7d2ea1b46985-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:39 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3e1680b0-ba94-4a52-9049-665d60eb79d3" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-quobyte-3e1680b0-ba94-4a52-9049-665d60eb79d3" released by "delete_volume" :: held 0.972s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Created reservations ['ccb77357-ebec-4d74-b2d2-d6cbbc8d32d3', '86970bd4-001c-4f8d-8e18-c9118dac55f9', '49c967c1-2f59-443c-8acd-10a048eb0694', 'd5ff5280-121f-4076-93d1-67818e14a954'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:39 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:39 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:39 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:39 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Deleted volume successfully. Nov 02 11:47:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-75c2e2cf-4a9b-4988-84c5-978bbf1f8a17 tempest-ServerActionsTestOtherA-217023053 None] Lock "cinder-3e1680b0-ba94-4a52-9049-665d60eb79d3-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7d0e9ebb-8b32-4769-bce0-25adf6bb935c tempest-GroupSnapshotsTest-1416442453 None] Group tempest-GroupSnapshotsTest-Group-116484624: creating Nov 02 11:47:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7d0e9ebb-8b32-4769-bce0-25adf6bb935c tempest-GroupSnapshotsTest-1416442453 None] Group tempest-GroupSnapshotsTest-Group-116484624: created successfully Nov 02 11:47:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7d0e9ebb-8b32-4769-bce0-25adf6bb935c tempest-GroupSnapshotsTest-1416442453 None] Create group completed successfully. Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Flow 'volume_create_manager' (5d36e68b-93fa-4a47-8f76-c59beccbba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f8de51-ad2a-49c7-bc28-1c630e1420c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f8de51-ad2a-49c7-bc28-1c630e1420c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1768805342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e5b39b1d55492eb8c388e6b5157dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:44Z,use_quota=True,user_id='465beaaabb594a03a49fb8ad67f7b8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc72caf-21ec-40df-bc24-ce486c4530c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc72caf-21ec-40df-bc24-ce486c4530c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6bf0dc-e2d0-4b64-a1be-41bed02dfe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6bf0dc-e2d0-4b64-a1be-41bed02dfe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9', 'volume_name': 'volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34df72dd-7896-4151-a1d0-8bdc2d988b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34df72dd-7896-4151-a1d0-8bdc2d988b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186678b5-3636-4e60-9b14-07cbd793cce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Volume c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9', 'volume_size': 1} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1768805342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e5b39b1d55492eb8c388e6b5157dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:44Z,use_quota=True,user_id='465beaaabb594a03a49fb8ad67f7b8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Creating volume c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:44 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 1073741824 Nov 02 11:47:44 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:44 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 1073741824" returned: 0 in 0.623s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:47:44 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 Nov 02 11:47:44 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (84f98f11-d15e-4d37-93b0-76bd46682d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388267ea-9528-4f7d-acbd-79ffb1adc1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388267ea-9528-4f7d-acbd-79ffb1adc1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1038041555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2e35265-7b7d-46ce-9bcc-5e183e262424,host='devstack@QuobyteHD#QuobyteHD',id=419deaa6-7f1a-4919-8b98-cb2283f72592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:45Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ee4efd6-4f7f-4d77-8762-2bc1d6176e52),volume_type_id=0ee4efd6-4f7f-4d77-8762-2bc1d6176e52)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37856948-37b7-44de-b7b7-4524e64d5e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37856948-37b7-44de-b7b7-4524e64d5e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4782dd68-2c1a-4b1e-9c2c-49c3faf93004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4782dd68-2c1a-4b1e-9c2c-49c3faf93004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419deaa6-7f1a-4919-8b98-cb2283f72592', 'volume_name': 'volume-419deaa6-7f1a-4919-8b98-cb2283f72592', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db97d74-061a-4947-86fb-698c6ecf585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db97d74-061a-4947-86fb-698c6ecf585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f44b46c-6f76-439e-9dbd-0eccb500df59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Volume 419deaa6-7f1a-4919-8b98-cb2283f72592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419deaa6-7f1a-4919-8b98-cb2283f72592', 'volume_size': 1} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:45 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2e35265-7b7d-46ce-9bcc-5e183e262424,created_at=2026-11-02T10:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1038041555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2e35265-7b7d-46ce-9bcc-5e183e262424,host='devstack@QuobyteHD#QuobyteHD',id=419deaa6-7f1a-4919-8b98-cb2283f72592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:45Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ee4efd6-4f7f-4d77-8762-2bc1d6176e52),volume_type_id=0ee4efd6-4f7f-4d77-8762-2bc1d6176e52)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Creating volume 419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:45 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186678b5-3636-4e60-9b14-07cbd793cce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:45 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 1073741824 Nov 02 11:47:45 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319a0427-42c9-4a3a-8dac-921e280a1ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Volume volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 (c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9): created successfully Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319a0427-42c9-4a3a-8dac-921e280a1ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Flow 'volume_create_manager' (5d36e68b-93fa-4a47-8f76-c59beccbba13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ef8d6bc8-542f-40b5-b343-dcd1fc0cf52a tempest-VolumesServicesTestJSON-871557035 None] Created volume successfully. Nov 02 11:47:45 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 1073741824" returned: 0 in 0.560s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:45 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 Nov 02 11:47:45 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:46 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f44b46c-6f76-439e-9dbd-0eccb500df59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419deaa6-7f1a-4919-8b98-cb2283f72592', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a32e4e2-4f58-4f8f-9702-7cef02424ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Volume volume-419deaa6-7f1a-4919-8b98-cb2283f72592 (419deaa6-7f1a-4919-8b98-cb2283f72592): created successfully Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a32e4e2-4f58-4f8f-9702-7cef02424ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (84f98f11-d15e-4d37-93b0-76bd46682d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-300bc73b-6bd1-4111-baaf-fabeb774d3d3 tempest-GroupSnapshotsTest-1416442453 None] Created volume successfully. Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Acquiring lock "cinder-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Lock "cinder-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Acquiring lock "cinder-quobyte-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Lock "cinder-quobyte-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8c34c-7e49-4d97-9cc9-4ff42b79b9cf]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:46 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 Nov 02 11:47:46 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:47 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:47 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9 Nov 02 11:47:47 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:47 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Lock "cinder-quobyte-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9" released by "delete_volume" :: held 0.777s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Created reservations ['516de3c7-4de2-4e82-b9e7-952724c7bae2', 'ddacb8b4-dbb8-4198-8b86-f32b6eb07740', 'd8159dd6-3ac0-4ffe-83ac-f789b09dac0f', 'b51eb1d4-5acc-48e4-8bd3-8a5e2465a628'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:47 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:47 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] GroupSnapshot 52c7feab-55b9-4846-83e2-b01dd46d4aa7: creating. Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Group snapshot 52c7feab-55b9-4846-83e2-b01dd46d4aa7: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Creating offline snapshot ee7283d2-06c0-4407-8c1a-a3be73fbe95b of volume 419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2cfba2-a7ac-4411-b545-ba9cefabba36]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:47 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Deleted volume successfully. Nov 02 11:47:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b84a373-10a0-4700-99f4-9693db6833b4 tempest-VolumesServicesTestJSON-871557035 None] Lock "cinder-c6c993eb-20e5-4b5f-a6a1-2dad23cd15d9-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:48 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 Nov 02 11:47:48 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:48 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592" returned: 0 in 0.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:48 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b 1G Nov 02 11:47:48 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Flow 'volume_create_manager' (79ac0ede-1b54-43a3-8341-9eedb1036424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce03951c-539f-4745-a475-609ff9c6c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce03951c-539f-4745-a475-609ff9c6c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-353983093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdd1c00-e937-4aee-9782-950a35f7cff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720aace353e7495087e1222078842935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:49Z,use_quota=True,user_id='ec90681dc45445828d493c0524e82780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c08f2e8-dd02-4a59-a024-da365cad9b84),volume_type_id=9c08f2e8-dd02-4a59-a024-da365cad9b84)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50712414-41ea-4a89-a174-ca3747c40fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50712414-41ea-4a89-a174-ca3747c40fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41df3581-65f2-4a37-9363-9c712fae1b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41df3581-65f2-4a37-9363-9c712fae1b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bdd1c00-e937-4aee-9782-950a35f7cff0', 'volume_name': 'volume-0bdd1c00-e937-4aee-9782-950a35f7cff0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7eb7847-9d57-40dd-98db-9a367cc78d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7eb7847-9d57-40dd-98db-9a367cc78d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5b3a74-4c3a-417d-a839-c5fe96300af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Volume 0bdd1c00-e937-4aee-9782-950a35f7cff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bdd1c00-e937-4aee-9782-950a35f7cff0', 'volume_size': 1} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:48 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b 1G" returned: 0 in 0.619s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419deaa6-7f1a-4919-8b98-cb2283f72592 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:48 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419deaa6-7f1a-4919-8b98-cb2283f72592 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b Nov 02 11:47:48 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:49 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419deaa6-7f1a-4919-8b98-cb2283f72592 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b" returned: 0 in 0.351s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:49 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:47:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:49 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b Nov 02 11:47:49 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:49 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b" returned: 0 in 0.317s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:49 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.info Nov 02 11:47:49 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:50 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.info" returned: 0 in 0.384s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:50 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:50 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.info Nov 02 11:47:50 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:50 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.info" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-353983093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdd1c00-e937-4aee-9782-950a35f7cff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720aace353e7495087e1222078842935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:47:49Z,use_quota=True,user_id='ec90681dc45445828d493c0524e82780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c08f2e8-dd02-4a59-a024-da365cad9b84),volume_type_id=9c08f2e8-dd02-4a59-a024-da365cad9b84)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Creating volume 0bdd1c00-e937-4aee-9782-950a35f7cff0 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:50 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:50 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 1073741824 Nov 02 11:47:50 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-840e0c58-6b3b-44da-8fe5-fd8792ed5437 tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 52c7feab-55b9-4846-83e2-b01dd46d4aa7: created successfully Nov 02 11:47:50 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 1073741824" returned: 0 in 0.566s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:51 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 Nov 02 11:47:51 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:51 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:47:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5b3a74-4c3a-417d-a839-c5fe96300af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bdd1c00-e937-4aee-9782-950a35f7cff0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b53ef1b-88de-4579-8b5c-ac49f2b77fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:47:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Volume volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 (0bdd1c00-e937-4aee-9782-950a35f7cff0): created successfully Nov 02 11:47:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b53ef1b-88de-4579-8b5c-ac49f2b77fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:47:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Flow 'volume_create_manager' (79ac0ede-1b54-43a3-8341-9eedb1036424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:47:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2b824a5e-0064-4f1d-b642-b5c1fae88ff1 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Created volume successfully. Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-ee7283d2-06c0-4407-8c1a-a3be73fbe95b-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-ee7283d2-06c0-4407-8c1a-a3be73fbe95b-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Creating volume fe22677c-bf2c-4ef9-a872-eedfcc232e3f from snapshot ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] snapshot: ee7283d2-06c0-4407-8c1a-a3be73fbe95b, volume: fe22677c-bf2c-4ef9-a872-eedfcc232e3f, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94703fa-9607-4c93-8a8c-b6aeb0cb3026]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:52 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b Nov 02 11:47:52 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:52 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:52 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:52 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b" returned: 0 in 0.521s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-419deaa6-7f1a-4919-8b98-cb2283f72592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0dca88-0128-4552-9221-e82efe7a9e44]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:52 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 Nov 02 11:47:52 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:53 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:53 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e16ef31f-ff94-4c78-99f5-8aa9ee40919a tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Retype volume completed successfully. Nov 02 11:47:53 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:47:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:47:53 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:47:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:53 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f Nov 02 11:47:53 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2cd0f67-44f3-41e9-ab4e-1dce93d1ae20 tempest-BackendsCapabilitiesAdminTestsJSON-734025181 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8525581359863, 'free_capacity_gb': 1773.8525581359863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 11:47:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e6c1040-fd3c-44d9-b607-1667ae0eb608 tempest-BackendsCapabilitiesAdminTestsJSON-734025181 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8525581359863, 'free_capacity_gb': 1773.8525581359863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 11:47:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Acquiring lock "cinder-0bdd1c00-e937-4aee-9782-950a35f7cff0-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "cinder-0bdd1c00-e937-4aee-9782-950a35f7cff0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Acquiring lock "cinder-quobyte-0bdd1c00-e937-4aee-9782-950a35f7cff0" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:47:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "cinder-quobyte-0bdd1c00-e937-4aee-9782-950a35f7cff0" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:47:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c88fcc0-5a40-4f86-9b84-2a7f63ec6277]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:47:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:55 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 Nov 02 11:47:55 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:56 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0" returned: 0 in 1.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:56 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0 Nov 02 11:47:56 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:57 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0bdd1c00-e937-4aee-9782-950a35f7cff0" returned: 0 in 0.534s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "cinder-quobyte-0bdd1c00-e937-4aee-9782-950a35f7cff0" released by "delete_volume" :: held 1.946s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:47:57 devstack cinder-volume[86846]: WARNING cinder.quota [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:47:57 devstack cinder-volume[86846]: WARNING cinder.quota [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Created reservations ['4fe868dc-ac03-4a7c-9235-699aaa1d352b', '452eb45f-6497-4b55-9528-c14a35cf38bb', '5754d575-a95b-4971-bb99-2a96b55c54fa', '73f9de84-e645-439e-89d3-5c2985ec4730'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:47:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:47:57 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:47:57 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:47:58 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Nov 02 11:47:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:47:58 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:47:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Deleted volume successfully. Nov 02 11:47:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7c83c245-c0cb-492b-89c8-f309c541d3b8 tempest-VolumeRetypeWithoutMigrationTest-1816874832 None] Lock "cinder-0bdd1c00-e937-4aee-9782-950a35f7cff0-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:02 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" returned: 0 in 8.892s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:02 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:48:02 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Converted 1024.00 MB image at 115.15 MB/s Nov 02 11:48:02 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:48:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:02 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f Nov 02 11:48:02 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:02 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" released by "_copy_volume_from_snapshot" :: held 10.234s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-ee7283d2-06c0-4407-8c1a-a3be73fbe95b-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" released by "_create_volume_from_snapshot" :: held 10.323s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.346s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ec1c0c34-9b73-4f4c-99ae-8d1f1acc8dc8 tempest-GroupSnapshotsTest-1416442453 None] Create group from source-snapshot-52c7feab-55b9-4846-83e2-b01dd46d4aa7 completed successfully. Nov 02 11:48:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f625498b-5d8c-4f07-90a0-1b65c0674a7b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:04 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f Nov 02 11:48:04 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:04 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" returned: 0 in 0.522s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:04 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f Nov 02 11:48:04 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:04 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-fe22677c-bf2c-4ef9-a872-eedfcc232e3f" released by "delete_volume" :: held 0.942s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['adbfd0d0-04c0-4d04-ae41-755eb153f5c2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:04 devstack cinder-volume[86846]: WARNING cinder.quota [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-223083195 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-223083195, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:04 devstack cinder-volume[86846]: WARNING cinder.quota [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-223083195 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-223083195, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['6f2e7012-2fd0-428a-bdce-8ad011ead270', 'd15624ab-d8af-4247-8ebb-a4b888c35c99', '651f7a10-c99c-4eae-8971-94220effce1c', 'b74a266a-f7a2-400d-8911-4196a3d8e58d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:05 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:05 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:05 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d78ff8bc-2d3d-4410-a079-7937d83a7720 tempest-GroupSnapshotsTest-1416442453 None] Delete group completed successfully. Nov 02 11:48:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 52c7feab-55b9-4846-83e2-b01dd46d4aa7: deleting Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=116,cinder:UPDATE=131,cinder:INSERT=29,cinder:DELETE=11 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=121,cinder:UPDATE=146,cinder:INSERT=32,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 52c7feab-55b9-4846-83e2-b01dd46d4aa7: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-419deaa6-7f1a-4919-8b98-cb2283f72592" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-419deaa6-7f1a-4919-8b98-cb2283f72592" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-ee7283d2-06c0-4407-8c1a-a3be73fbe95b" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-ee7283d2-06c0-4407-8c1a-a3be73fbe95b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Deleting offline snapshot ee7283d2-06c0-4407-8c1a-a3be73fbe95b of volume 419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] snapshot_file for this snap is: volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[544536b2-b019-4d1e-b25b-461aaffbd8fd]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:06 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b Nov 02 11:48:06 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:06 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-419deaa6-7f1a-4919-8b98-cb2283f72592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a295e-b515-407d-a7b7-c374693406a0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:07 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 Nov 02 11:48:07 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:07 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592" returned: 0 in 0.597s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:07 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b Nov 02 11:48:07 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:08 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b" returned: 0 in 0.474s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:08 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b Nov 02 11:48:08 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:08 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592.ee7283d2-06c0-4407-8c1a-a3be73fbe95b" returned: 0 in 0.416s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-ee7283d2-06c0-4407-8c1a-a3be73fbe95b" released by "_delete_snapshot" :: held 2.102s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-419deaa6-7f1a-4919-8b98-cb2283f72592" released by "delete_snapshot" :: held 2.137s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:08 devstack cinder-volume[86846]: WARNING cinder.quota [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-223083195 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-223083195, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:08 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['9c995847-ef06-44c3-a97a-0d74d17c1264', '96483079-5b0d-4349-8604-e65039188132', 'bba420f0-1ade-48b8-9039-aeb52ecd6fcf', 'f5de3b38-75cf-448d-b692-64dc67a8ffc0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7856caf9-0c89-4095-9fb6-701b3ca46e5a tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 52c7feab-55b9-4846-83e2-b01dd46d4aa7: deleted successfully Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-419deaa6-7f1a-4919-8b98-cb2283f72592" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-419deaa6-7f1a-4919-8b98-cb2283f72592" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e18af2-df6e-4e51-ab3f-d7fcc67bb87e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:09 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 Nov 02 11:48:09 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:09 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592" returned: 0 in 0.434s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:09 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592 Nov 02 11:48:09 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Flow 'volume_create_manager' (de1ad5ac-7173-4b22-8aa1-06895b891ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81845318-ebd7-438f-bbab-e5e0605b400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81845318-ebd7-438f-bbab-e5e0605b400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2025910311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01830942e55c46d58570a9ad47e3f9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:10Z,use_quota=True,user_id='a716aadcddc449b8b2581040a39d0829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df8a70a-b34b-4108-b845-313b874dc57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df8a70a-b34b-4108-b845-313b874dc57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e02f382-04b7-447b-a9f0-11fcdb756a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:10 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e02f382-04b7-447b-a9f0-11fcdb756a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c', 'volume_name': 'volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058ef7e-b206-4bfa-ab7a-3d9ffb2ec4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058ef7e-b206-4bfa-ab7a-3d9ffb2ec4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874686bb-0c8a-42d5-b66b-a1b51bc624c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Volume ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c', 'volume_size': 1} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2025910311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01830942e55c46d58570a9ad47e3f9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:10Z,use_quota=True,user_id='a716aadcddc449b8b2581040a39d0829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Creating volume ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:10 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-419deaa6-7f1a-4919-8b98-cb2283f72592" returned: 0 in 0.406s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-419deaa6-7f1a-4919-8b98-cb2283f72592" released by "delete_volume" :: held 0.953s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:10 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c 1073741824 Nov 02 11:48:10 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['6afd6696-0fc5-4923-841f-2d0bb9026c49'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:10 devstack cinder-volume[86846]: WARNING cinder.db.api [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-223083195'] Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['4e147081-619d-428a-8eb9-38758a663278', '8e348a15-a1d1-48ec-8e6d-179d41311fb4', 'b9b6bd85-6545-4030-99ac-5657395e2337', '21820985-be24-420e-92d2-e44e4fd53bfe'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:10 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:10 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:10 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c 1073741824" returned: 0 in 0.598s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:10 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c Nov 02 11:48:10 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:10 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.364s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:10 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-04894149-045a-405d-88d0-0ff149b0b34e tempest-GroupSnapshotsTest-1416442453 None] Delete group completed successfully. Nov 02 11:48:11 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874686bb-0c8a-42d5-b66b-a1b51bc624c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21725295-a920-4ef0-af86-ecfaec9bbd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Volume volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c (ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c): created successfully Nov 02 11:48:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21725295-a920-4ef0-af86-ecfaec9bbd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Flow 'volume_create_manager' (de1ad5ac-7173-4b22-8aa1-06895b891ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9ac11fe7-4f1d-4b7f-8074-0036233ea968 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Created volume successfully. Nov 02 11:48:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c73f033e-30ee-4010-a120-1d29b740ece2 tempest-GroupSnapshotsTest-1416442453 None] Group tempest-GroupSnapshotsTest-Group-1215657864: creating Nov 02 11:48:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c73f033e-30ee-4010-a120-1d29b740ece2 tempest-GroupSnapshotsTest-1416442453 None] Group tempest-GroupSnapshotsTest-Group-1215657864: created successfully Nov 02 11:48:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c73f033e-30ee-4010-a120-1d29b740ece2 tempest-GroupSnapshotsTest-1416442453 None] Create group completed successfully. Nov 02 11:48:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Creating offline snapshot ca9818da-fd9d-4d60-917e-e9a7f0d9526c of volume ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7149e0-e4ac-4e5b-898b-832a282c277b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:12 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c Nov 02 11:48:12 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:12 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:12 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c 1G Nov 02 11:48:12 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:13 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c 1G" returned: 0 in 0.712s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:13 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c Nov 02 11:48:13 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (8d169fdb-36ec-4672-ba9c-2e3423070c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c01830-15b7-4689-89cd-1772f86c5694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c01830-15b7-4689-89cd-1772f86c5694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-647571987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de673fe5-6fe7-4d24-b5d8-bb98a8c3dfef,host='devstack@QuobyteHD#QuobyteHD',id=820a95c8-ea20-450a-a7e4-ce75b41c4262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:14Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecced7ac-6abf-454b-b2ff-2af321293d18),volume_type_id=ecced7ac-6abf-454b-b2ff-2af321293d18)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057654e4-9966-436d-844f-8d05dc86fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057654e4-9966-436d-844f-8d05dc86fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baf18e0-25b6-4cf3-9216-aad2b5c6e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baf18e0-25b6-4cf3-9216-aad2b5c6e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820a95c8-ea20-450a-a7e4-ce75b41c4262', 'volume_name': 'volume-820a95c8-ea20-450a-a7e4-ce75b41c4262', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6bf7db-468f-4c1c-bbc4-bb85d097706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6bf7db-468f-4c1c-bbc4-bb85d097706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35523fbe-1b12-4692-880c-adc6da6b59fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Volume 820a95c8-ea20-450a-a7e4-ce75b41c4262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820a95c8-ea20-450a-a7e4-ce75b41c4262', 'volume_size': 1} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c" returned: 0 in 0.530s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c is being set with open permissions: ugo+rw Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:14 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c Nov 02 11:48:14 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:14 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c" returned: 0 in 0.261s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:14 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.info Nov 02 11:48:14 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:14 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.info" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.info is being set with open permissions: ugo+rw Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:14 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.info Nov 02 11:48:14 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Flow 'volume_create_manager' (df3c60ff-b86f-4ab8-862a-2eeabe696a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2c040d-e0e6-47f4-a1e1-9cbf5e7b332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2c040d-e0e6-47f4-a1e1-9cbf5e7b332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-500721658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050a688a-c0e4-4e9d-a3dd-5e30a93bdc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe8d09be6b241bfbf8a1e2b58c12b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:15Z,use_quota=True,user_id='1af9c8df287346e9929f375a5482bf26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49777754-5a15-432a-b7f9-1e712d3ce93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49777754-5a15-432a-b7f9-1e712d3ce93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b053369-4f59-47d9-ab20-033beb7e3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b053369-4f59-47d9-ab20-033beb7e3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '050a688a-c0e4-4e9d-a3dd-5e30a93bdc62', 'volume_name': 'volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1badfda2-d6a6-45e9-8bf9-e84bf221fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1badfda2-d6a6-45e9-8bf9-e84bf221fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef07c7b5-6d66-434c-96e1-0c13609ae197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62', 'volume_size': 1} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:14 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.info" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=de673fe5-6fe7-4d24-b5d8-bb98a8c3dfef,created_at=2026-11-02T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-647571987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de673fe5-6fe7-4d24-b5d8-bb98a8c3dfef,host='devstack@QuobyteHD#QuobyteHD',id=820a95c8-ea20-450a-a7e4-ce75b41c4262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:14Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecced7ac-6abf-454b-b2ff-2af321293d18),volume_type_id=ecced7ac-6abf-454b-b2ff-2af321293d18)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Creating volume 820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:15 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 1073741824 Nov 02 11:48:15 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fe51c2ff-6329-47f6-bfa5-1d659e6a73ec tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Create snapshot completed successfully Nov 02 11:48:15 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 1073741824" returned: 0 in 0.507s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:15 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 Nov 02 11:48:15 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:15 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-500721658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050a688a-c0e4-4e9d-a3dd-5e30a93bdc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fe8d09be6b241bfbf8a1e2b58c12b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:15Z,use_quota=True,user_id='1af9c8df287346e9929f375a5482bf26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Creating volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35523fbe-1b12-4692-880c-adc6da6b59fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820a95c8-ea20-450a-a7e4-ce75b41c4262', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:15 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 1073741824 Nov 02 11:48:15 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec836e5-c8b7-4902-80de-3c71343f2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Volume volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 (820a95c8-ea20-450a-a7e4-ce75b41c4262): created successfully Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec836e5-c8b7-4902-80de-3c71343f2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (8d169fdb-36ec-4672-ba9c-2e3423070c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ec15b374-4b92-4b8c-a9ba-e634d102a51d tempest-GroupSnapshotsTest-1416442453 None] Created volume successfully. Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "cinder-ca9818da-fd9d-4d60-917e-e9a7f0d9526c-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-ca9818da-fd9d-4d60-917e-e9a7f0d9526c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "cinder-quobyte-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-quobyte-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "cinder-quobyte-ca9818da-fd9d-4d60-917e-e9a7f0d9526c" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-quobyte-ca9818da-fd9d-4d60-917e-e9a7f0d9526c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Deleting offline snapshot ca9818da-fd9d-4d60-917e-e9a7f0d9526c of volume ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] snapshot_file for this snap is: volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c044f9a-3e36-42a8-a1f6-d40c9d490cbc]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:16 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c Nov 02 11:48:16 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:16 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 1073741824" returned: 0 in 0.518s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:16 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 Nov 02 11:48:16 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:16 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd2ac8c-b410-411a-b1a2-ea852aea04d0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:16 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:16 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c Nov 02 11:48:16 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef07c7b5-6d66-434c-96e1-0c13609ae197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2005edc0-56fa-4afa-a8d8-574597e8c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Volume volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 (050a688a-c0e4-4e9d-a3dd-5e30a93bdc62): created successfully Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2005edc0-56fa-4afa-a8d8-574597e8c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Flow 'volume_create_manager' (df3c60ff-b86f-4ab8-862a-2eeabe696a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-811a6013-ca1c-4ca8-a6ca-8fdba92e0082 tempest-SnapshotsActionsTest-393370773 None] Created volume successfully. Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:17 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (3b4b0dc0-8aef-4b7a-9446-7fb79991906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b745fb1-7931-4041-8994-975b8a7ee9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" returned: 0 in 0.518s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b745fb1-7931-4041-8994-975b8a7ee9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256318406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de673fe5-6fe7-4d24-b5d8-bb98a8c3dfef,host='devstack@QuobyteHD#QuobyteHD',id=24c5acfe-46eb-4dfa-a1f2-798a9902505c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:17Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecced7ac-6abf-454b-b2ff-2af321293d18),volume_type_id=ecced7ac-6abf-454b-b2ff-2af321293d18)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:17 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f75682a-2dd9-464d-abd6-5e4d0eef7621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:17 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f75682a-2dd9-464d-abd6-5e4d0eef7621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6328043d-08de-4e0d-9165-1e7745f7c790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6328043d-08de-4e0d-9165-1e7745f7c790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c5acfe-46eb-4dfa-a1f2-798a9902505c', 'volume_name': 'volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f514762d-7f0c-4eb8-9f11-ff646d33a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f514762d-7f0c-4eb8-9f11-ff646d33a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e02f74-1c0f-4282-861f-6ce28ee092dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:17 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Volume 24c5acfe-46eb-4dfa-a1f2-798a9902505c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c', 'volume_size': 1} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=de673fe5-6fe7-4d24-b5d8-bb98a8c3dfef,created_at=2026-11-02T10:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256318406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de673fe5-6fe7-4d24-b5d8-bb98a8c3dfef,host='devstack@QuobyteHD#QuobyteHD',id=24c5acfe-46eb-4dfa-a1f2-798a9902505c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:17Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecced7ac-6abf-454b-b2ff-2af321293d18),volume_type_id=ecced7ac-6abf-454b-b2ff-2af321293d18)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Creating volume 24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:17 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:17 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c 1073741824 Nov 02 11:48:17 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:17 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:17 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c Nov 02 11:48:17 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:17 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c 1073741824" returned: 0 in 0.529s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:17 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c Nov 02 11:48:17 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:17 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c.ca9818da-fd9d-4d60-917e-e9a7f0d9526c" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-quobyte-ca9818da-fd9d-4d60-917e-e9a7f0d9526c" released by "_delete_snapshot" :: held 1.887s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-quobyte-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" released by "delete_snapshot" :: held 1.921s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Created reservations ['24b4fbf1-3181-42cc-a6fa-8a955daa4ce3', 'fbee96d0-b1c1-47c4-a288-8a83924bde43', 'ae4e9423-e682-41a4-8ca0-4172f8f03003', 'de1cc17f-ec0c-4caa-80f4-f5ab03ae7768'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:18 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e02f74-1c0f-4282-861f-6ce28ee092dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae03efca-d2b0-408a-9eb3-85f1bf38e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Delete snapshot completed successfully. Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-abca6803-1bb7-430b-a23c-38ec4c47cdfa tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-ca9818da-fd9d-4d60-917e-e9a7f0d9526c-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Volume volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c (24c5acfe-46eb-4dfa-a1f2-798a9902505c): created successfully Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae03efca-d2b0-408a-9eb3-85f1bf38e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (3b4b0dc0-8aef-4b7a-9446-7fb79991906d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5cbe3e19-eb13-4970-be26-5a3c46c69e65 tempest-GroupSnapshotsTest-1416442453 None] Created volume successfully. Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Creating offline snapshot 238add93-c69d-465e-a5b5-d46a3b28d69a of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f5524-639e-4e13-b9b9-31e3f2f9102e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "cinder-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "cinder-quobyte-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-quobyte-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:18 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 Nov 02 11:48:18 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da82876-d06a-4477-ad33-ed2520856a71]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f2e18efe-728c-4daa-beb2-64249de1786b tempest-GroupSnapshotsTest-1416442453 None] Update group completed successfully. Nov 02 11:48:18 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c Nov 02 11:48:18 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:18 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:18 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:19 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" returned: 0 in 0.754s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:19 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" returned: 0 in 0.513s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:19 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a 1G Nov 02 11:48:19 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:19 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:19 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c Nov 02 11:48:19 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:48:19 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-quobyte-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c" released by "delete_volume" :: held 0.919s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Created reservations ['afd2b2db-003e-4b04-9cb5-523bea885ea2', 'b18d52af-ed06-4aa7-bb34-33df28f4a272', '7cf89267-d205-43bb-9af0-14ed524f4c60', '82ca2f85-cfaa-4216-9fee-58a9ed58b0d7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:19 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:19 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:19 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a 1G" returned: 0 in 0.602s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:19 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:19 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e6ff5428-98ed-496c-ba1f-693c75c206e7 tempest-GroupSnapshotsTest-1416442453 None] Update group completed successfully. Nov 02 11:48:20 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Deleted volume successfully. Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8fab9788-8d4d-4bb1-bbc0-53c627bc5042 tempest-VolumeSnapshotQuotasNegativeTestJSON-360734811 None] Lock "cinder-ef2750ec-4b9d-45e5-ad7a-0f67f8c5142c-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:20 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:20 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a is being set with open permissions: ugo+rw Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:20 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:20 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:20 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:20 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.info Nov 02 11:48:20 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:20 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.info" returned: 0 in 0.268s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:20 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.info is being set with open permissions: ugo+rw Nov 02 11:48:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:20 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.info Nov 02 11:48:20 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:21 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.info" returned: 0 in 0.335s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7b890306-fec9-4fb4-acbc-1f4b3abaa58c tempest-SnapshotsActionsTest-393370773 None] Create snapshot completed successfully Nov 02 11:48:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c598e365-aaa1-4d60-9847-84c070e70b43 tempest-GroupSnapshotsTest-1416442453 None] Update group completed successfully. Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Creating offline snapshot 86f09931-b676-4452-a9b0-06cbe833037b of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a59f03-1a69-46ac-a256-650edac229d8]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-be9b90db-c020-4d38-b98a-dacc7a521351 tempest-GroupSnapshotsTest-1416442453 None] Update group completed successfully. Nov 02 11:48:22 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:22 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:22 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.459s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:22 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b 1G Nov 02 11:48:22 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:23 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b 1G" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:23 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b Nov 02 11:48:23 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:23 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:23 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b is being set with open permissions: ugo+rw Nov 02 11:48:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:23 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b Nov 02 11:48:23 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] GroupSnapshot 8f343011-216e-4372-82ab-c60db60d121e: creating. Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Group snapshot 8f343011-216e-4372-82ab-c60db60d121e: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:24 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.150s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Creating offline snapshot 12e866df-bd97-4879-a946-ca13db02948e of volume 820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6afa932b-e462-4cbc-bdfa-ae7f17256e7e tempest-SnapshotsActionsTest-393370773 None] Create snapshot completed successfully Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[125677f4-e851-41cc-8033-0aa73651d0a2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:24 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 Nov 02 11:48:24 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:24 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:24 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e 1G Nov 02 11:48:24 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:25 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e 1G" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:25 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e Nov 02 11:48:25 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-86f09931-b676-4452-a9b0-06cbe833037b-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-86f09931-b676-4452-a9b0-06cbe833037b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-86f09931-b676-4452-a9b0-06cbe833037b" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-86f09931-b676-4452-a9b0-06cbe833037b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Deleting offline snapshot 86f09931-b676-4452-a9b0-06cbe833037b of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] snapshot_file for this snap is: volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:25 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:25 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d0eea7-b9d4-4546-948a-24e0736b02b9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:25 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e Nov 02 11:48:25 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:25 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b Nov 02 11:48:25 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:26 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:26 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.info Nov 02 11:48:26 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:26 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b" returned: 0 in 0.484s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[119882e7-f842-4db8-9359-746bfad63f85]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:26 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.info" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:26 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:26 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:26 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:26 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.info Nov 02 11:48:26 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:26 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.info" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Creating offline snapshot a122c7b7-95c2-46aa-9525-afb308c18fee of volume 24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2ce8d5-eb18-4848-9246-d7f4232f3d07]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:26 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.607s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:26 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b Nov 02 11:48:26 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:27 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c Nov 02 11:48:27 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:27 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c" returned: 0 in 0.437s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:27 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee 1G Nov 02 11:48:27 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:27 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b" returned: 0 in 0.454s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:27 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b Nov 02 11:48:27 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:27 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.86f09931-b676-4452-a9b0-06cbe833037b" returned: 0 in 0.310s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-86f09931-b676-4452-a9b0-06cbe833037b" released by "_delete_snapshot" :: held 2.012s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" released by "delete_snapshot" :: held 2.046s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Created reservations ['a581437e-10e5-4e83-8d9b-0f695d93e7ba', '27688816-46a1-4715-a103-4c25a5594e3d', '38af9c17-1151-416e-bf5c-a7088ff753d1', '322522a9-0e6f-4565-850d-fec124e705fa'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:27 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee 1G" returned: 0 in 0.571s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:27 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee Nov 02 11:48:27 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Delete snapshot completed successfully. Nov 02 11:48:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4b1ada0d-0c30-410b-a2af-0cfd71544bca tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-86f09931-b676-4452-a9b0-06cbe833037b-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:28 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:28 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:48:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:28 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee Nov 02 11:48:28 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:28 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:28 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.info Nov 02 11:48:28 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:29 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.info" returned: 0 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:29 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:29 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.info Nov 02 11:48:29 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:29 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.info" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.136s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Creating offline snapshot e6b494f1-31a5-4080-af8a-d15b98034413 of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f547a9-8081-480c-a0b1-9f07360f96ee]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b6910182-96f6-439f-87bf-d510ad1f2389 tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 8f343011-216e-4372-82ab-c60db60d121e: created successfully Nov 02 11:48:29 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:29 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:30 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.412s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:30 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 1G Nov 02 11:48:30 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:30 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 1G" returned: 0 in 0.633s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 8f343011-216e-4372-82ab-c60db60d121e: deleting Nov 02 11:48:30 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 Nov 02 11:48:30 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 8f343011-216e-4372-82ab-c60db60d121e: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-820a95c8-ea20-450a-a7e4-ce75b41c4262" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-820a95c8-ea20-450a-a7e4-ce75b41c4262" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-12e866df-bd97-4879-a946-ca13db02948e" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-12e866df-bd97-4879-a946-ca13db02948e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Deleting offline snapshot 12e866df-bd97-4879-a946-ca13db02948e of volume 820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] snapshot_file for this snap is: volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f1f521-31e8-444e-83a4-0e644baabe6e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:31 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e Nov 02 11:48:31 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:31 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:31 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 is being set with open permissions: ugo+rw Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:31 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 Nov 02 11:48:31 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:31 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e" returned: 0 in 0.548s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820a95c8-ea20-450a-a7e4-ce75b41c4262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[618b94e3-4c43-4a65-9ca0-59649b81b6af]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:31 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413" returned: 0 in 0.397s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ba60a052-67bf-4004-b64f-e4934278c43a tempest-SnapshotsActionsTest-393370773 None] Create snapshot completed successfully Nov 02 11:48:31 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 Nov 02 11:48:31 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:32 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262" returned: 0 in 0.506s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:32 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e Nov 02 11:48:32 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:32 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e" returned: 0 in 0.436s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:32 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e Nov 02 11:48:32 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-e6b494f1-31a5-4080-af8a-d15b98034413-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-e6b494f1-31a5-4080-af8a-d15b98034413-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-e6b494f1-31a5-4080-af8a-d15b98034413" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-e6b494f1-31a5-4080-af8a-d15b98034413" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Deleting offline snapshot e6b494f1-31a5-4080-af8a-d15b98034413 of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] snapshot_file for this snap is: volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:32 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262.12e866df-bd97-4879-a946-ca13db02948e" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6271a156-745f-4b71-8601-c5f2a5bc912c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-12e866df-bd97-4879-a946-ca13db02948e" released by "_delete_snapshot" :: held 2.114s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-820a95c8-ea20-450a-a7e4-ce75b41c4262" released by "delete_snapshot" :: held 2.153s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-24c5acfe-46eb-4dfa-a1f2-798a9902505c" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-24c5acfe-46eb-4dfa-a1f2-798a9902505c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-a122c7b7-95c2-46aa-9525-afb308c18fee" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-a122c7b7-95c2-46aa-9525-afb308c18fee" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Deleting offline snapshot a122c7b7-95c2-46aa-9525-afb308c18fee of volume 24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:33 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] snapshot_file for this snap is: volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:33 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc0b0e-d8cb-4735-a14c-816813fd7977]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:33 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee Nov 02 11:48:33 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:33 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413" returned: 0 in 0.585s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4980d769-46aa-405c-bebf-4528417685d2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:33 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5bf0ff-29dd-4742-9861-153292fcee7a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:33 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:33 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:33 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c Nov 02 11:48:33 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:34 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.569s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:34 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:34 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 Nov 02 11:48:34 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c" returned: 0 in 0.494s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:34 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee Nov 02 11:48:34 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:34 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413" returned: 0 in 0.571s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:34 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee" returned: 0 in 0.548s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:34 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee Nov 02 11:48:34 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:34 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413 Nov 02 11:48:34 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:35 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c.a122c7b7-95c2-46aa-9525-afb308c18fee" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-a122c7b7-95c2-46aa-9525-afb308c18fee" released by "_delete_snapshot" :: held 2.051s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-24c5acfe-46eb-4dfa-a1f2-798a9902505c" released by "delete_snapshot" :: held 2.108s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:35 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.e6b494f1-31a5-4080-af8a-d15b98034413" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-e6b494f1-31a5-4080-af8a-d15b98034413" released by "_delete_snapshot" :: held 2.435s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" released by "delete_snapshot" :: held 2.487s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:35 devstack cinder-volume[86846]: WARNING cinder.quota [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1773744304 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1773744304, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:35 devstack cinder-volume[86846]: WARNING cinder.quota [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1773744304 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1773744304, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['83adaa30-7784-4a5c-a34b-08edffcb48d9', 'ff2a9adc-6923-4cbe-87db-ea2fe921122f', 'cd403aa6-e99e-4fc4-9b0b-916598d5e91d', 'd0c1fd98-f570-49d3-84fd-7f00bf2a8ba6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Created reservations ['7896d6d8-82e4-4be8-a791-66eb5fc1a410', '687155d1-e374-41de-8fb5-66269b29aa11', '4b55cb0d-9ea4-4250-a022-a73dc198de1c', '3e185ae5-81d1-43de-ace1-c02283f32cc0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Delete snapshot completed successfully. Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-14f4e93a-e116-4fca-99bd-39a22f8cae3f tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-e6b494f1-31a5-4080-af8a-d15b98034413-delete_snapshot" released by "delete_snapshot" :: held 2.769s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['c3bee247-ed10-40d2-aff1-ec2287ca2f02', 'ed2d0915-5ca0-46a1-ba5c-4b5acacdb036', '93997bdc-3e8b-40d6-a383-2ea5e7d941c5', 'f883cf5c-82dc-4682-8f7d-8fe9e53c109a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6eda3a36-8200-4596-a099-826355417ea1 tempest-GroupSnapshotsTest-1416442453 None] group_snapshot 8f343011-216e-4372-82ab-c60db60d121e: deleted successfully Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Creating offline snapshot 10d6889a-66d2-4e93-bada-2239750a13d7 of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e67515-b47d-4c2b-beb1-e1c409f9b6da]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:36 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:36 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Flow 'volume_create_manager' (e4080e72-f0e3-4fb9-bcb1-7be58f8bb691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f77732-09be-4598-81ef-20b9d9e46ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f77732-09be-4598-81ef-20b9d9e46ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1504263923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55d77d6-44c0-4924-a982-cd623e75ddcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2003a36eda09410298639d46d773cec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:37Z,use_quota=True,user_id='a0c32282abba43b2933a49365b6fee19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be130b1b-d842-4b1a-88b8-0fe2219fcfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be130b1b-d842-4b1a-88b8-0fe2219fcfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651e63c1-b2b3-451a-9568-74d6661d8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651e63c1-b2b3-451a-9568-74d6661d8b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c55d77d6-44c0-4924-a982-cd623e75ddcf', 'volume_name': 'volume-c55d77d6-44c0-4924-a982-cd623e75ddcf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2f3913-8e86-4350-bea2-63c78679ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2f3913-8e86-4350-bea2-63c78679ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:36 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e497d22f-03db-4ee6-bb66-8a79b1ccc500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Volume c55d77d6-44c0-4924-a982-cd623e75ddcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c55d77d6-44c0-4924-a982-cd623e75ddcf', 'volume_size': 1} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.484s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:36 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 1G Nov 02 11:48:36 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-24c5acfe-46eb-4dfa-a1f2-798a9902505c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-24c5acfe-46eb-4dfa-a1f2-798a9902505c" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb953a-ec6c-45bf-bfb8-ac8868f17a59]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:37 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c Nov 02 11:48:37 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:37 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 1G" returned: 0 in 0.570s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:37 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 Nov 02 11:48:37 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:37 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:37 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c Nov 02 11:48:37 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:37 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7" returned: 0 in 0.335s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:37 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 is being set with open permissions: ugo+rw Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:37 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 Nov 02 11:48:37 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:37 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-24c5acfe-46eb-4dfa-a1f2-798a9902505c" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-24c5acfe-46eb-4dfa-a1f2-798a9902505c" released by "delete_volume" :: held 0.883s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-820a95c8-ea20-450a-a7e4-ce75b41c4262" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-820a95c8-ea20-450a-a7e4-ce75b41c4262" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dfe661-0020-43cd-b031-7516279dd838]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:38 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.238s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1504263923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55d77d6-44c0-4924-a982-cd623e75ddcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2003a36eda09410298639d46d773cec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:37Z,use_quota=True,user_id='a0c32282abba43b2933a49365b6fee19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Creating volume c55d77d6-44c0-4924-a982-cd623e75ddcf {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:38 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:38 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 Nov 02 11:48:38 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:38 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf 1073741824 Nov 02 11:48:38 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-72330c95-d79e-4f1a-9cab-63d87a0e30bc tempest-SnapshotsActionsTest-393370773 None] Create snapshot completed successfully Nov 02 11:48:38 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:38 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262 Nov 02 11:48:38 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-10d6889a-66d2-4e93-bada-2239750a13d7-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-10d6889a-66d2-4e93-bada-2239750a13d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-10d6889a-66d2-4e93-bada-2239750a13d7" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-10d6889a-66d2-4e93-bada-2239750a13d7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Deleting offline snapshot 10d6889a-66d2-4e93-bada-2239750a13d7 of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:38 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] snapshot_file for this snap is: volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf 1073741824" returned: 0 in 0.696s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[57656d88-57b9-4acc-862a-efa82a2e92ec]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:38 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-820a95c8-ea20-450a-a7e4-ce75b41c4262" returned: 0 in 0.412s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-820a95c8-ea20-450a-a7e4-ce75b41c4262" released by "delete_volume" :: held 0.966s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:39 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf Nov 02 11:48:39 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:39 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 Nov 02 11:48:39 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['676a965d-3888-4b0a-a54e-d92e0c4f5502'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:39 devstack cinder-volume[86846]: WARNING cinder.quota [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1773744304 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1773744304, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['ea83c124-daa3-47d7-87b7-52c94bc88733', 'fd94ead6-13e3-4c35-8753-b35dc3350a51', 'e442ef68-ae8d-48b3-919e-f94825dc5cbb', '71f92132-38e5-46cb-91e8-58979c9abcf1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:39 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e497d22f-03db-4ee6-bb66-8a79b1ccc500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c55d77d6-44c0-4924-a982-cd623e75ddcf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ae1a5f-39e2-46e9-8f8a-85500fd77058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Volume volume-c55d77d6-44c0-4924-a982-cd623e75ddcf (c55d77d6-44c0-4924-a982-cd623e75ddcf): created successfully Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ae1a5f-39e2-46e9-8f8a-85500fd77058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Flow 'volume_create_manager' (e4080e72-f0e3-4fb9-bcb1-7be58f8bb691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-50980aba-4fca-4015-a98e-4d6631d9e478 tempest-AbsoluteLimitsTests-254665930 None] Created volume successfully. Nov 02 11:48:39 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7" returned: 0 in 0.494s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e64a3-05d8-4bd6-99df-642856e00e76]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['37f9a962-c951-4876-b1a2-23d2b4edd019', '3012e775-f9b6-4b20-9440-95acc917143f', '126d7995-6029-4772-86c1-c4f1dcb3c883', '83344e57-624a-410d-94a4-240829bd3ba8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:39 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:39 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:39 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:39 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.596s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:39 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:40 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 Nov 02 11:48:40 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:40 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.482s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c00e2763-bb95-43c2-bc19-248bd6a98c66 tempest-GroupSnapshotsTest-1416442453 None] Delete group completed successfully. Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Acquiring lock "cinder-c55d77d6-44c0-4924-a982-cd623e75ddcf-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Lock "cinder-c55d77d6-44c0-4924-a982-cd623e75ddcf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Acquiring lock "cinder-quobyte-c55d77d6-44c0-4924-a982-cd623e75ddcf" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Lock "cinder-quobyte-c55d77d6-44c0-4924-a982-cd623e75ddcf" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d2295-1785-4ab4-8812-c2ffec0ca862]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:40 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7" returned: 0 in 0.503s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:40 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7 Nov 02 11:48:40 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:40 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf Nov 02 11:48:40 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:40 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.10d6889a-66d2-4e93-bada-2239750a13d7" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-10d6889a-66d2-4e93-bada-2239750a13d7" released by "_delete_snapshot" :: held 2.079s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" released by "delete_snapshot" :: held 2.123s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:40 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf" returned: 0 in 0.480s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:40 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf Nov 02 11:48:40 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:40 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Created reservations ['274c3f55-bec2-4296-b27c-44296dd7a1d9', '01b2c711-6b51-4e29-898c-3c4acaf30947', 'de45a57e-9367-4427-8b58-aa180722222a', '7414d056-b8ca-46ef-990a-e49153288d11'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Delete snapshot completed successfully. Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b9db03e1-58d0-46b4-8356-936e48310a20 tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-10d6889a-66d2-4e93-bada-2239750a13d7-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a6933746-a9b1-42b6-aa76-c1a07be1d09e tempest-GroupSnapshotsTest-1416442453 None] Group tempest-GroupSnapshotsTest-Group-1572349722: creating Nov 02 11:48:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a6933746-a9b1-42b6-aa76-c1a07be1d09e tempest-GroupSnapshotsTest-1416442453 None] Group tempest-GroupSnapshotsTest-Group-1572349722: created successfully Nov 02 11:48:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a6933746-a9b1-42b6-aa76-c1a07be1d09e tempest-GroupSnapshotsTest-1416442453 None] Create group completed successfully. Nov 02 11:48:41 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c55d77d6-44c0-4924-a982-cd623e75ddcf" returned: 0 in 0.312s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Lock "cinder-quobyte-c55d77d6-44c0-4924-a982-cd623e75ddcf" released by "delete_volume" :: held 0.844s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Created reservations ['7b64f801-dcf8-4a33-99b7-ad7d9c19b2b0', '750b83e7-ba5e-4924-b186-dc85bd917bac', '41cb97d8-77b7-4b02-816e-edfd8c186930', '8fc94ab2-aba6-4428-8dd7-93d1902b99aa'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:41 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:41 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:41 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Deleted volume successfully. Nov 02 11:48:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe43347d-41bf-4917-92ef-a8bc7918cdb0 tempest-AbsoluteLimitsTests-254665930 None] Lock "cinder-c55d77d6-44c0-4924-a982-cd623e75ddcf-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Creating offline snapshot aa303b9a-867d-4347-a2d1-dfff5146ebcc of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae60509-ac83-48f9-9d3e-ec8b9553a43f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:43 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:43 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:43 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.664s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:43 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc 1G Nov 02 11:48:43 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (150d1653-a203-4dbe-801d-9b86929863dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8005dac-bd8d-42e1-b009-9c94859beaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8005dac-bd8d-42e1-b009-9c94859beaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596692042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38e212bc-4c9e-4bab-ab91-d206d8bac593,host='devstack@QuobyteHD#QuobyteHD',id=74919576-1b1a-492f-aa78-2eaeb9aa3bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:44Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af0b04ec-f291-4829-ae5e-00fd571c6214),volume_type_id=af0b04ec-f291-4829-ae5e-00fd571c6214)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8697ea-a818-4695-b6c9-aa948b070674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8697ea-a818-4695-b6c9-aa948b070674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2deec67d-e375-4f0b-a8cc-82e518f5533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2deec67d-e375-4f0b-a8cc-82e518f5533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74919576-1b1a-492f-aa78-2eaeb9aa3bdf', 'volume_name': 'volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aeb00da-5880-4983-8d2a-660ebffd3cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aeb00da-5880-4983-8d2a-660ebffd3cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5132c8c-dbd5-45e5-a653-0255429a1294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Volume 74919576-1b1a-492f-aa78-2eaeb9aa3bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf', 'volume_size': 1} Nov 02 11:48:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:44 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc 1G" returned: 0 in 0.850s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:44 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc Nov 02 11:48:44 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:44 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:44 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc is being set with open permissions: ugo+rw Nov 02 11:48:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:44 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc Nov 02 11:48:44 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:45 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38e212bc-4c9e-4bab-ab91-d206d8bac593,created_at=2026-11-02T10:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-596692042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38e212bc-4c9e-4bab-ab91-d206d8bac593,host='devstack@QuobyteHD#QuobyteHD',id=74919576-1b1a-492f-aa78-2eaeb9aa3bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5abdd805ca4c79a9711616e90a1c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:44Z,use_quota=True,user_id='23aea2a2212b4619943139c3e93ef842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af0b04ec-f291-4829-ae5e-00fd571c6214),volume_type_id=af0b04ec-f291-4829-ae5e-00fd571c6214)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Creating volume 74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:45 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:45 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf 1073741824 Nov 02 11:48:45 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f3c9137f-decb-4d25-8d8a-2f1a637ee8c0 tempest-SnapshotsActionsTest-393370773 None] Create snapshot completed successfully Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-aa303b9a-867d-4347-a2d1-dfff5146ebcc-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-aa303b9a-867d-4347-a2d1-dfff5146ebcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Acquiring lock "cinder-quobyte-aa303b9a-867d-4347-a2d1-dfff5146ebcc" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:46 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (d5176647-a89a-4252-99f8-8e53417c8faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f856b2-2045-4f43-84f4-3ecfe625e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf 1073741824" returned: 0 in 0.854s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-aa303b9a-867d-4347-a2d1-dfff5146ebcc" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Deleting offline snapshot aa303b9a-867d-4347-a2d1-dfff5146ebcc of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] snapshot_file for this snap is: volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f856b2-2045-4f43-84f4-3ecfe625e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524784310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223c684-b410-43c5-94d8-80528836941b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:46Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d58a41-b5a3-4e23-b25f-91646aa034c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d58a41-b5a3-4e23-b25f-91646aa034c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2e4966-4bde-4f3c-8255-cbc9feb9bcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2e4966-4bde-4f3c-8255-cbc9feb9bcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e223c684-b410-43c5-94d8-80528836941b', 'volume_name': 'volume-e223c684-b410-43c5-94d8-80528836941b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f5ea74-8b0b-4f04-8af1-d6201ba6f9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f5ea74-8b0b-4f04-8af1-d6201ba6f9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c2c125-948a-4316-880b-aed0a7ef88e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Volume e223c684-b410-43c5-94d8-80528836941b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e223c684-b410-43c5-94d8-80528836941b', 'volume_size': 1} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c518da-dcfe-4fc5-a803-8739347820c7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:46 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf Nov 02 11:48:46 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:46 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc Nov 02 11:48:46 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:46 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524784310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223c684-b410-43c5-94d8-80528836941b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:46Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Creating volume e223c684-b410-43c5-94d8-80528836941b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:46 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:46 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5132c8c-dbd5-45e5-a653-0255429a1294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:46 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b 1073741824 Nov 02 11:48:46 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e00bc1-d2e2-494f-a2a8-6f86f36905de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc" returned: 0 in 0.514s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Volume volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf (74919576-1b1a-492f-aa78-2eaeb9aa3bdf): created successfully Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e00bc1-d2e2-494f-a2a8-6f86f36905de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Flow 'volume_create_manager' (150d1653-a203-4dbe-801d-9b86929863dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b9b53-cd2c-47ba-8fb9-5ddf13e81a47]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d0b1699f-adce-42fd-8a07-798c21819ede tempest-GroupSnapshotsTest-1416442453 None] Created volume successfully. Nov 02 11:48:46 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:46 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:47 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b 1073741824" returned: 0 in 0.618s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:47 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b Nov 02 11:48:47 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:47 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.581s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:47 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc Nov 02 11:48:47 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:47 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c2c125-948a-4316-880b-aed0a7ef88e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e223c684-b410-43c5-94d8-80528836941b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541940ac-e62b-4ee9-8118-f8096ecc2fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Volume volume-e223c684-b410-43c5-94d8-80528836941b (e223c684-b410-43c5-94d8-80528836941b): created successfully Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541940ac-e62b-4ee9-8118-f8096ecc2fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (d5176647-a89a-4252-99f8-8e53417c8faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5ee11480-3a7c-402f-93a3-5e01d32a5b5d tempest-VolumesActionsTest-1255948252 None] Created volume successfully. Nov 02 11:48:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] GroupSnapshot dba3f778-f17b-4a5a-a5ee-f06380b76598: creating. Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Group snapshot dba3f778-f17b-4a5a-a5ee-f06380b76598: creating. {{(pid=86846) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2f089568-fc72-4113-a09e-07660997e2e8 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "cinder-e223c684-b410-43c5-94d8-80528836941b" by "attach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:48 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc" returned: 0 in 0.689s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Creating offline snapshot 95a5f55c-f52c-4efc-9a9f-eadc09e08545 of volume 74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[58695dd5-9c50-4107-9fed-93c58fc3b891]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:48 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc Nov 02 11:48:48 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2f089568-fc72-4113-a09e-07660997e2e8 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b" acquired by "attach_volume" :: waited 0.061s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2f089568-fc72-4113-a09e-07660997e2e8 tempest-VolumesActionsTest-1255948252 None] Attaching volume e223c684-b410-43c5-94d8-80528836941b to instance 567ec6a4-da04-4bc1-ad78-a62f998dde81 at mountpoint /dev/vdb on host None. Nov 02 11:48:48 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf Nov 02 11:48:48 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2f089568-fc72-4113-a09e-07660997e2e8 tempest-VolumesActionsTest-1255948252 None] Attach volume completed successfully. Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2f089568-fc72-4113-a09e-07660997e2e8 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b" released by "attach_volume" :: held 0.150s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:48 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.aa303b9a-867d-4347-a2d1-dfff5146ebcc" returned: 0 in 0.568s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-aa303b9a-867d-4347-a2d1-dfff5146ebcc" released by "_delete_snapshot" :: held 2.656s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" released by "delete_snapshot" :: held 2.734s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:48 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" returned: 0 in 0.725s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Created reservations ['e1c42833-f33a-4857-a5dd-039296dbfad0', 'e61da23d-811d-489b-aeaf-874885c4c47b', 'a71b51ab-e59e-4978-88ac-ef79ca120b9b', '315b1a4e-642a-4a65-bcb1-70e212c1b909'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:48 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 1G Nov 02 11:48:48 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Delete snapshot completed successfully. Nov 02 11:48:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9adc7fe-5097-4ffb-9f51-9077a00085ed tempest-SnapshotsActionsTest-1791155055 None] Lock "cinder-aa303b9a-867d-4347-a2d1-dfff5146ebcc-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a36d744c-a922-4173-b5dd-4fcc1028693c tempest-VolumesActionsTest-661696349 None] Terminate volume connection completed successfully. Nov 02 11:48:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a36d744c-a922-4173-b5dd-4fcc1028693c tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-e223c684-b410-43c5-94d8-80528836941b-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a36d744c-a922-4173-b5dd-4fcc1028693c tempest-VolumesActionsTest-661696349 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b-detach_volume" acquired by "detach_volume" :: waited 0.083s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a36d744c-a922-4173-b5dd-4fcc1028693c tempest-VolumesActionsTest-661696349 None] Detaching volume e223c684-b410-43c5-94d8-80528836941b from instance 567ec6a4-da04-4bc1-ad78-a62f998dde81. Nov 02 11:48:49 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 1G" returned: 0 in 1.091s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:50 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 Nov 02 11:48:50 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a36d744c-a922-4173-b5dd-4fcc1028693c tempest-VolumesActionsTest-661696349 None] Detach volume completed successfully. Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a36d744c-a922-4173-b5dd-4fcc1028693c tempest-VolumesActionsTest-661696349 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b-detach_volume" released by "detach_volume" :: held 0.250s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2151faca-01b2-485b-a54a-712207d541e6 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "cinder-e223c684-b410-43c5-94d8-80528836941b-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2151faca-01b2-485b-a54a-712207d541e6 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2151faca-01b2-485b-a54a-712207d541e6 tempest-VolumesActionsTest-1255948252 None] Volume detach called, but volume not attached. Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "cinder-238add93-c69d-465e-a5b5-d46a3b28d69a-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2151faca-01b2-485b-a54a-712207d541e6 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-238add93-c69d-465e-a5b5-d46a3b28d69a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "cinder-quobyte-238add93-c69d-465e-a5b5-d46a3b28d69a" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-quobyte-238add93-c69d-465e-a5b5-d46a3b28d69a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Deleting offline snapshot 238add93-c69d-465e-a5b5-d46a3b28d69a of volume 050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] snapshot_file for this snap is: volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:50 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f26648-0f5d-4ba8-afec-e1de61940043]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545" returned: 0 in 0.681s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:50 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:50 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 Nov 02 11:48:50 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:50 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:50 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Acquiring lock "cinder-e223c684-b410-43c5-94d8-80528836941b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Acquiring lock "cinder-quobyte-e223c684-b410-43c5-94d8-80528836941b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Lock "cinder-quobyte-e223c684-b410-43c5-94d8-80528836941b" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa72a49c-eddd-41e5-8394-857473ad4eb0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:51 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545" returned: 0 in 0.504s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:51 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.554s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda28f6-71e2-421b-bd28-27c0116d2afd]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:51 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.info Nov 02 11:48:51 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:51 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b Nov 02 11:48:51 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:51 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 Nov 02 11:48:51 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:51 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b" returned: 0 in 0.512s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:51 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.info" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:51 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:51 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b Nov 02 11:48:51 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:51 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.info Nov 02 11:48:51 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:51 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" returned: 0 in 0.597s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:51 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:51 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:51 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e223c684-b410-43c5-94d8-80528836941b" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Lock "cinder-quobyte-e223c684-b410-43c5-94d8-80528836941b" released by "delete_volume" :: held 0.879s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:52 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.info" returned: 0 in 0.436s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.092s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Created reservations ['e9539fde-ca70-4959-ba46-132b8aba9679', '55d34f8a-88e7-4fa3-a14d-82a88880b278', 'b92593f7-7adf-49a5-91c7-73ec2a864514', 'c67826ab-2b48-4d2c-89e5-001d95aace78'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5daf1f62-d77a-4b54-879a-66fc2353b5a6 tempest-GroupSnapshotsTest-1416442453 None] group_snapshot dba3f778-f17b-4a5a-a5ee-f06380b76598: created successfully Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:52 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:52 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:52 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.750s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:52 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a Nov 02 11:48:52 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] group_snapshot dba3f778-f17b-4a5a-a5ee-f06380b76598: deleting Nov 02 11:48:52 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] group_snapshot dba3f778-f17b-4a5a-a5ee-f06380b76598: deleting {{(pid=86846) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 11:48:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Deleted volume successfully. Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c7c6240f-8f69-439d-b138-103b1e916bee tempest-VolumesActionsTest-1255948252 None] Lock "cinder-e223c684-b410-43c5-94d8-80528836941b-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-95a5f55c-f52c-4efc-9a9f-eadc09e08545" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-95a5f55c-f52c-4efc-9a9f-eadc09e08545" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Deleting offline snapshot 95a5f55c-f52c-4efc-9a9f-eadc09e08545 of volume 74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] snapshot_file for this snap is: volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:48:53 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62.238add93-c69d-465e-a5b5-d46a3b28d69a" returned: 0 in 0.487s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff570fa-1abf-4027-bfbe-f059bd370fbc]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-quobyte-238add93-c69d-465e-a5b5-d46a3b28d69a" released by "_delete_snapshot" :: held 2.612s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" released by "delete_snapshot" :: held 2.652s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Created reservations ['f927717e-d6d9-40ff-829b-5f73ec39d1fd', '08941dee-28c4-4ab9-a71a-5e05eb92307e', '4387a57e-0d36-4cf5-bda6-bb54b800ed51', '093360b4-3158-43da-af9d-46d7da9b0273'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:53 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 Nov 02 11:48:53 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Delete snapshot completed successfully. Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-013bbe49-a52a-412a-aa9a-b9fba8d5d98e tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-238add93-c69d-465e-a5b5-d46a3b28d69a-delete_snapshot" released by "delete_snapshot" :: held 2.899s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:53 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545" returned: 0 in 0.593s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[edac08aa-0d6c-4d50-ae05-b36ccc23fd66]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:53 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf Nov 02 11:48:53 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "cinder-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60c68e-3be2-4578-bf48-c62f9bad9dda]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:54 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" returned: 0 in 0.666s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:54 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 Nov 02 11:48:54 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:54 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 Nov 02 11:48:54 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:54 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545" returned: 0 in 0.482s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:54 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545 Nov 02 11:48:54 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:54 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" returned: 0 in 0.589s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:54 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62 Nov 02 11:48:54 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:55 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf.95a5f55c-f52c-4efc-9a9f-eadc09e08545" returned: 0 in 0.301s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:55 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-95a5f55c-f52c-4efc-9a9f-eadc09e08545" released by "_delete_snapshot" :: held 2.251s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-quobyte-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62" released by "delete_volume" :: held 0.999s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" released by "delete_snapshot" :: held 2.304s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Created reservations ['43477377-ddb2-471a-a5fc-6bd613769795', '9921a03f-5eab-483b-bbaa-2846e06386ab', 'c9433bfd-9c98-499e-8211-951a0aad793f', 'd813ac8c-2876-4bbb-ab06-1f92b89eca02'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:55 devstack cinder-volume[86846]: WARNING cinder.quota [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-487519152 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-487519152, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:55 devstack cinder-volume[86846]: WARNING cinder.quota [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-487519152 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-487519152, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['489cacac-82e3-4690-9c2c-a9bf58989ed3', '5ecc7749-e59f-4624-9e65-943fa6902e43', '550d130a-7eb4-4a90-bd44-8d06a591fecd', 'e10e2911-26ea-4b78-bfdc-b18edda410cd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:55 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:55 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dd2ec654-e6b4-4412-8785-43371f5be2bd tempest-GroupSnapshotsTest-1416442453 None] group_snapshot dba3f778-f17b-4a5a-a5ee-f06380b76598: deleted successfully Nov 02 11:48:55 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Deleted volume successfully. Nov 02 11:48:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6c0ebfc0-b629-4e40-b127-68fa042749b0 tempest-SnapshotsActionsTest-393370773 None] Lock "cinder-050a688a-c0e4-4e9d-a3dd-5e30a93bdc62-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "cinder-quobyte-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:48:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" acquired by "delete_volume" :: waited 0.046s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:48:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ea593-4121-440c-9212-68fe61844fb3]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:48:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:57 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf Nov 02 11:48:57 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:57 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" returned: 0 in 0.719s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:57 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf Nov 02 11:48:57 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (c94a8f74-1597-4fc8-80fb-4d13af6081c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00501a19-7605-47d5-9bbf-83bd1f2f0b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00501a19-7605-47d5-9bbf-83bd1f2f0b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1253063195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6525564d-2478-4250-a8d0-b1a5c998fd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:58Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eea5f8a-c402-4f4d-b2d1-d751bd6ee93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eea5f8a-c402-4f4d-b2d1-d751bd6ee93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4e9527-f228-4425-b933-dae1777a9cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4e9527-f228-4425-b933-dae1777a9cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6525564d-2478-4250-a8d0-b1a5c998fd40', 'volume_name': 'volume-6525564d-2478-4250-a8d0-b1a5c998fd40', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d16842-93f3-4f67-a987-1b342bacd127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d16842-93f3-4f67-a987-1b342bacd127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeafd8cf-8f60-4426-820c-477fc8f48d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Volume 6525564d-2478-4250-a8d0-b1a5c998fd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6525564d-2478-4250-a8d0-b1a5c998fd40', 'volume_size': 1} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1253063195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6525564d-2478-4250-a8d0-b1a5c998fd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:48:58Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Creating volume 6525564d-2478-4250-a8d0-b1a5c998fd40 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:48:57 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:48:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:57 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 1073741824 Nov 02 11:48:57 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:58 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Lock "cinder-quobyte-74919576-1b1a-492f-aa78-2eaeb9aa3bdf" released by "delete_volume" :: held 1.227s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['cad1815a-b969-40ee-9825-cce0b0d73d90'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:58 devstack cinder-volume[86846]: WARNING cinder.quota [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-487519152 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-487519152, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Created reservations ['d52e214b-d9d7-432a-b8bd-6a8db682fb5c', '8fd4b221-141f-412c-88e5-78a54f659c49', 'd47a838b-731b-4d15-b3f5-10576fce479b', '2296f84c-7d46-48bd-937b-fd71647c069d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:58 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:48:58 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:58 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 1073741824" returned: 0 in 0.683s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:48:58 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 Nov 02 11:48:58 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:48:58 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:48:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9e681a7f-a7f7-4b84-9a3d-ee07ccae8036 tempest-GroupSnapshotsTest-1416442453 None] Delete group completed successfully. Nov 02 11:48:58 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeafd8cf-8f60-4426-820c-477fc8f48d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6525564d-2478-4250-a8d0-b1a5c998fd40', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f3e4c4-6191-4a5c-8a98-fa80f7f17708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:48:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Volume volume-6525564d-2478-4250-a8d0-b1a5c998fd40 (6525564d-2478-4250-a8d0-b1a5c998fd40): created successfully Nov 02 11:48:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f3e4c4-6191-4a5c-8a98-fa80f7f17708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:48:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (c94a8f74-1597-4fc8-80fb-4d13af6081c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:48:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a9160504-c822-4ca4-827c-5f971bfce57c tempest-VolumesActionsTest-1255948252 None] Created volume successfully. Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-6525564d-2478-4250-a8d0-b1a5c998fd40-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Lock "cinder-6525564d-2478-4250-a8d0-b1a5c998fd40-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-quobyte-6525564d-2478-4250-a8d0-b1a5c998fd40" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-6525564d-2478-4250-a8d0-b1a5c998fd40" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[67908ae8-59aa-45ce-b284-d34981d4b7e1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:00 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 Nov 02 11:49:00 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:00 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40" returned: 0 in 0.537s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:00 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40 Nov 02 11:49:00 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:01 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6525564d-2478-4250-a8d0-b1a5c998fd40" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-6525564d-2478-4250-a8d0-b1a5c998fd40" released by "delete_volume" :: held 0.968s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Created reservations ['fe8bcbab-42e1-4de9-a483-3630b96b8c85', '1b016f11-e074-4ddb-b35d-3ad782240f82', '3302e809-205f-421e-be34-3da557ccfb0f', 'e499ad81-b75c-4b37-b6ac-b1e435da3790'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:01 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:01 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:01 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Deleted volume successfully. Nov 02 11:49:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a1c72b6-3533-411d-a8a4-fca82a51d74f tempest-VolumesActionsTest-661696349 None] Lock "cinder-6525564d-2478-4250-a8d0-b1a5c998fd40-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (e8e4e8c2-18a3-4a64-8429-91105db1baca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5124ea98-e0e7-4b75-8878-2deac8edcf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5124ea98-e0e7-4b75-8878-2deac8edcf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175246346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d8fea-7be0-48d8-853b-4e8eabbcd796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:03Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7475a8-02ad-48d2-9112-a615fd2d8df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7475a8-02ad-48d2-9112-a615fd2d8df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc78d45-f515-4b71-acae-576de29228c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc78d45-f515-4b71-acae-576de29228c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70d8fea-7be0-48d8-853b-4e8eabbcd796', 'volume_name': 'volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da7a816-820b-4e3a-8156-60d3c173db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da7a816-820b-4e3a-8156-60d3c173db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9cd17e-2de5-4625-bf8d-38a579a12dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Volume f70d8fea-7be0-48d8-853b-4e8eabbcd796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796', 'volume_size': 1} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175246346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d8fea-7be0-48d8-853b-4e8eabbcd796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:03Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Creating volume f70d8fea-7be0-48d8-853b-4e8eabbcd796 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:49:03 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:03 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 1073741824 Nov 02 11:49:03 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:03 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 1073741824" returned: 0 in 0.622s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:04 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 Nov 02 11:49:04 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:04 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9cd17e-2de5-4625-bf8d-38a579a12dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ed5b22-b534-4acc-aa4e-8978d6e86d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Volume volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 (f70d8fea-7be0-48d8-853b-4e8eabbcd796): created successfully Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ed5b22-b534-4acc-aa4e-8978d6e86d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (e8e4e8c2-18a3-4a64-8429-91105db1baca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2754e302-4214-45e4-b0cd-4ebf74283126 tempest-VolumesActionsTest-1255948252 None] Created volume successfully. Nov 02 11:49:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-f70d8fea-7be0-48d8-853b-4e8eabbcd796-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Lock "cinder-f70d8fea-7be0-48d8-853b-4e8eabbcd796-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-quobyte-f70d8fea-7be0-48d8-853b-4e8eabbcd796" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-f70d8fea-7be0-48d8-853b-4e8eabbcd796" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d104d-7c65-4ecd-95c3-509831ec01ae]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:05 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 Nov 02 11:49:05 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:06 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796" returned: 0 in 0.397s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:06 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796 Nov 02 11:49:06 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:06 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f70d8fea-7be0-48d8-853b-4e8eabbcd796" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-f70d8fea-7be0-48d8-853b-4e8eabbcd796" released by "delete_volume" :: held 0.744s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=179,cinder:INSERT=50,cinder:UPDATE=191,cinder:DELETE=12 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=178,cinder:UPDATE=183,cinder:INSERT=45,cinder:DELETE=8 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Created reservations ['4ce56d9b-4a54-47a3-8849-780dec740098', '52612b16-ffe8-4a35-a344-e2a302561492', '4cb2c6db-a182-4ca7-8cad-d92fc5c01b3f', '0335ee59-3820-40e7-bfdc-881c72a061ab'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:06 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:06 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:06 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Deleted volume successfully. Nov 02 11:49:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8d3c0326-80be-4bb7-ba53-c9ccfe38c1f9 tempest-VolumesActionsTest-661696349 None] Lock "cinder-f70d8fea-7be0-48d8-853b-4e8eabbcd796-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Flow 'volume_create_manager' (fc933d5e-d6e9-413b-8b11-e9027e877f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01b8b6e-b0a3-432d-b336-548a5932dad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01b8b6e-b0a3-432d-b336-548a5932dad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315980348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc5b9b9-509f-4119-aee1-696ef77a999f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf278679da640a59f284ea29e456b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:07Z,use_quota=True,user_id='5289ab90bfae4273bf19b8e50c3cb458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ac35a5-f3c0-4800-b858-2cff44427eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ac35a5-f3c0-4800-b858-2cff44427eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6464896-fd1c-48b0-a1a8-d94543cc78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6464896-fd1c-48b0-a1a8-d94543cc78bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc5b9b9-509f-4119-aee1-696ef77a999f', 'volume_name': 'volume-fcc5b9b9-509f-4119-aee1-696ef77a999f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a09cc53-9db6-49af-83a8-58d627e2c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a09cc53-9db6-49af-83a8-58d627e2c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786196e7-6091-4238-9909-8d1fdc17a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Volume fcc5b9b9-509f-4119-aee1-696ef77a999f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc5b9b9-509f-4119-aee1-696ef77a999f', 'volume_size': 1} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315980348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc5b9b9-509f-4119-aee1-696ef77a999f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf278679da640a59f284ea29e456b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:07Z,use_quota=True,user_id='5289ab90bfae4273bf19b8e50c3cb458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Creating volume fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:49:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:07 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f 1073741824 Nov 02 11:49:07 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (a7b4c956-4b17-423d-a17b-2abc772eace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201d7476-0f2b-4d2e-b445-a45131ae0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (201d7476-0f2b-4d2e-b445-a45131ae0430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005128466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7684df5-b29b-4fa4-96d4-290787c7cb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:08Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14738546-2ffd-4f00-b582-05e42b14207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14738546-2ffd-4f00-b582-05e42b14207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e25d2e-5819-4002-9bf9-2f468f2ae5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e25d2e-5819-4002-9bf9-2f468f2ae5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7684df5-b29b-4fa4-96d4-290787c7cb14', 'volume_name': 'volume-c7684df5-b29b-4fa4-96d4-290787c7cb14', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0dba96-f0c0-457f-b686-e33fb1817917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0dba96-f0c0-457f-b686-e33fb1817917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe8ad7a-20fd-4fb8-8b6c-013550555fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Volume c7684df5-b29b-4fa4-96d4-290787c7cb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7684df5-b29b-4fa4-96d4-290787c7cb14', 'volume_size': 1} Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:07 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2a6c5f6d-9655-4c30-b178-1a922144214a tempest-GroupsV320Test-43642536 None] Group tempest-GroupsV320Test-Group-196901453: creating Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f 1073741824" returned: 0 in 0.593s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2a6c5f6d-9655-4c30-b178-1a922144214a tempest-GroupsV320Test-43642536 None] Group tempest-GroupsV320Test-Group-196901453: created successfully Nov 02 11:49:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2a6c5f6d-9655-4c30-b178-1a922144214a tempest-GroupsV320Test-43642536 None] Create group completed successfully. Nov 02 11:49:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:07 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:49:07 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:08 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.257s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005128466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7684df5-b29b-4fa4-96d4-290787c7cb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:08Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Creating volume c7684df5-b29b-4fa4-96d4-290787c7cb14 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:49:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786196e7-6091-4238-9909-8d1fdc17a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc5b9b9-509f-4119-aee1-696ef77a999f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:08 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 1073741824 Nov 02 11:49:08 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283e713b-9b17-47e5-9aae-7b825419d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Volume volume-fcc5b9b9-509f-4119-aee1-696ef77a999f (fcc5b9b9-509f-4119-aee1-696ef77a999f): created successfully Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283e713b-9b17-47e5-9aae-7b825419d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Flow 'volume_create_manager' (fc933d5e-d6e9-413b-8b11-e9027e877f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e548d4b4-c47b-449c-b34d-99153801b3de tempest-VolumesActionsTest-1350569994 None] Created volume successfully. Nov 02 11:49:08 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 1073741824" returned: 0 in 0.463s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:08 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 Nov 02 11:49:08 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:08 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:49:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe8ad7a-20fd-4fb8-8b6c-013550555fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7684df5-b29b-4fa4-96d4-290787c7cb14', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c15b131-7f96-4c63-a3ee-14e4570deffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Volume volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 (c7684df5-b29b-4fa4-96d4-290787c7cb14): created successfully Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c15b131-7f96-4c63-a3ee-14e4570deffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (a7b4c956-4b17-423d-a17b-2abc772eace0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2cff6481-6f5e-4833-a7bc-bc66077e7ff7 tempest-VolumesActionsTest-1255948252 None] Created volume successfully. Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Created reservations ['cc468c40-41ef-4a00-8383-25298791aa08'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:09 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:09 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-c7684df5-b29b-4fa4-96d4-290787c7cb14-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:09 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Lock "cinder-c7684df5-b29b-4fa4-96d4-290787c7cb14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:09 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e1eba2a9-6485-4ee5-b512-661de3de66af tempest-GroupsV320Test-43642536 None] Delete group completed successfully. Nov 02 11:49:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-quobyte-c7684df5-b29b-4fa4-96d4-290787c7cb14" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-c7684df5-b29b-4fa4-96d4-290787c7cb14" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e10440-022d-4930-8fa3-b013adaa7717]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:10 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 Nov 02 11:49:10 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:10 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14" returned: 0 in 0.454s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:10 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14 Nov 02 11:49:10 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:10 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c7684df5-b29b-4fa4-96d4-290787c7cb14" returned: 0 in 0.457s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-c7684df5-b29b-4fa4-96d4-290787c7cb14" released by "delete_volume" :: held 0.980s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Created reservations ['a2fd7c14-0429-471d-b1ee-42a38dadfeba', 'e5cd7b03-2e71-4d05-9884-eda74e45afef', '21b69ea7-eacd-4049-89da-6f08b862c05d', 'ff73c8b2-941c-4f0b-9d73-526c1c1afc29'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:11 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:11 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:11 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Deleted volume successfully. Nov 02 11:49:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9e62a7c6-b575-40a1-8d8e-0557e8681eb3 tempest-VolumesActionsTest-661696349 None] Lock "cinder-c7684df5-b29b-4fa4-96d4-290787c7cb14-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (35aa9bb7-8f78-4cf7-a0e5-db2756fbf70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595318b7-b0b6-48b9-976c-763eee2b7de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595318b7-b0b6-48b9-976c-763eee2b7de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1674344847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2cdf8b-e1ef-45be-b80c-80b170fff06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:13Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ee887d-2443-4fc6-b448-9e09bcf0681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ee887d-2443-4fc6-b448-9e09bcf0681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8915a1-50ba-4f38-9149-234c462d88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8915a1-50ba-4f38-9149-234c462d88ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2cdf8b-e1ef-45be-b80c-80b170fff06b', 'volume_name': 'volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839903e9-68f9-45ee-95b5-8807d5e84531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839903e9-68f9-45ee-95b5-8807d5e84531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a121733b-9781-435f-acba-d0f069eb6c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Volume 4f2cdf8b-e1ef-45be-b80c-80b170fff06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b', 'volume_size': 1} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1674344847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2cdf8b-e1ef-45be-b80c-80b170fff06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:13Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Creating volume 4f2cdf8b-e1ef-45be-b80c-80b170fff06b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:49:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:49:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:12 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b 1073741824 Nov 02 11:49:12 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:13 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b 1073741824" returned: 0 in 0.594s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:13 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b Nov 02 11:49:13 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:13 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:49:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a121733b-9781-435f-acba-d0f069eb6c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cef4cb-d5e9-44ba-8a15-6add434bc3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Volume volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b (4f2cdf8b-e1ef-45be-b80c-80b170fff06b): created successfully Nov 02 11:49:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cef4cb-d5e9-44ba-8a15-6add434bc3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (35aa9bb7-8f78-4cf7-a0e5-db2756fbf70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f41e8763-91f6-4af3-b945-e1a0204ac915 tempest-VolumesActionsTest-1255948252 None] Created volume successfully. Nov 02 11:49:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-4f2cdf8b-e1ef-45be-b80c-80b170fff06b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Lock "cinder-4f2cdf8b-e1ef-45be-b80c-80b170fff06b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Acquiring lock "cinder-quobyte-4f2cdf8b-e1ef-45be-b80c-80b170fff06b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-4f2cdf8b-e1ef-45be-b80c-80b170fff06b" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d62c4ce-3ca6-4b97-a5cb-66702c1c54ed]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:16 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b Nov 02 11:49:16 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:16 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b" returned: 0 in 0.798s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:16 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b Nov 02 11:49:16 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:17 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4f2cdf8b-e1ef-45be-b80c-80b170fff06b" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Lock "cinder-quobyte-4f2cdf8b-e1ef-45be-b80c-80b170fff06b" released by "delete_volume" :: held 1.381s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Created reservations ['c8809f0b-8dd0-4263-9e5c-8d964fb70609', 'bf20bed9-a5f6-4172-878c-d597300f0256', '2832f10a-e7fd-4d5f-a875-75df36f06b5b', 'f5d7b047-6e06-4a79-baa9-9c7e37e3b04c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:17 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:17 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:17 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Deleted volume successfully. Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e1f0bf49-7474-4160-8ee9-3d1df6b39308 tempest-VolumesActionsTest-1350569994 None] Acquiring lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f" by "attach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e1f0bf49-7474-4160-8ee9-3d1df6b39308 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f" acquired by "attach_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-740d8dc7-c2a2-4634-bad3-b2dfeb8e4076 tempest-VolumesActionsTest-661696349 None] Lock "cinder-4f2cdf8b-e1ef-45be-b80c-80b170fff06b-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e1f0bf49-7474-4160-8ee9-3d1df6b39308 tempest-VolumesActionsTest-1350569994 None] Attaching volume fcc5b9b9-509f-4119-aee1-696ef77a999f to instance a63c98da-7ca7-4621-aea8-699bd5896f7f at mountpoint /dev/vdb on host None. Nov 02 11:49:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e1f0bf49-7474-4160-8ee9-3d1df6b39308 tempest-VolumesActionsTest-1350569994 None] Attach volume completed successfully. Nov 02 11:49:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e1f0bf49-7474-4160-8ee9-3d1df6b39308 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f" released by "attach_volume" :: held 0.145s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0dd735a-250f-4209-a83a-51594394401c tempest-VolumesActionsTest-1350569994 None] Acquiring lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0dd735a-250f-4209-a83a-51594394401c tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d0dd735a-250f-4209-a83a-51594394401c tempest-VolumesActionsTest-1350569994 None] Detaching volume fcc5b9b9-509f-4119-aee1-696ef77a999f from instance a63c98da-7ca7-4621-aea8-699bd5896f7f. Nov 02 11:49:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d0dd735a-250f-4209-a83a-51594394401c tempest-VolumesActionsTest-1350569994 None] Detach volume completed successfully. Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d0dd735a-250f-4209-a83a-51594394401c tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:18 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:18 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (b1a9b57f-503d-4407-a055-d8c9ca966e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339becbf-f9c6-4134-a112-0944de26aaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339becbf-f9c6-4134-a112-0944de26aaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675397653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41f6094-30c4-4546-bba7-7a98626b2b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:19Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa84249c-daea-4244-9bfd-5465e52c588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa84249c-daea-4244-9bfd-5465e52c588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f04ad74-a9ac-433a-9f09-e16934370e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f04ad74-a9ac-433a-9f09-e16934370e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41f6094-30c4-4546-bba7-7a98626b2b7b', 'volume_name': 'volume-d41f6094-30c4-4546-bba7-7a98626b2b7b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b89e535-6b7f-45e0-9481-e5dd35f037af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b89e535-6b7f-45e0-9481-e5dd35f037af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ffd46e-2dd0-4460-9883-48cf56b25b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:19 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Volume d41f6094-30c4-4546-bba7-7a98626b2b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41f6094-30c4-4546-bba7-7a98626b2b7b', 'volume_size': 1} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675397653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41f6094-30c4-4546-bba7-7a98626b2b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c25fa33bb2479aa2cb4b374ef0ba28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:19Z,use_quota=True,user_id='2ab101e233814ad8b7d626a1aa9ca1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Creating volume d41f6094-30c4-4546-bba7-7a98626b2b7b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:49:19 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:19 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b 1073741824 Nov 02 11:49:19 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:19 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.343s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:49:19 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b 1073741824" returned: 0 in 0.881s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:20 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b Nov 02 11:49:20 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:20 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ffd46e-2dd0-4460-9883-48cf56b25b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41f6094-30c4-4546-bba7-7a98626b2b7b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e9257b-437a-4e47-b891-c75278e9dd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Volume volume-d41f6094-30c4-4546-bba7-7a98626b2b7b (d41f6094-30c4-4546-bba7-7a98626b2b7b): created successfully Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e9257b-437a-4e47-b891-c75278e9dd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Flow 'volume_create_manager' (b1a9b57f-503d-4407-a055-d8c9ca966e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b48884a0-c581-4c20-b6d7-f9fa00d01f12 tempest-VolumesActionsTest-1255948252 None] Created volume successfully. Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "cinder-d41f6094-30c4-4546-bba7-7a98626b2b7b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-d41f6094-30c4-4546-bba7-7a98626b2b7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "cinder-quobyte-d41f6094-30c4-4546-bba7-7a98626b2b7b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-quobyte-d41f6094-30c4-4546-bba7-7a98626b2b7b" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8539ec-dfec-47f3-a52a-d8be80f17788]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:22 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b Nov 02 11:49:22 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:22 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:22 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b Nov 02 11:49:22 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:22 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d41f6094-30c4-4546-bba7-7a98626b2b7b" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-quobyte-d41f6094-30c4-4546-bba7-7a98626b2b7b" released by "delete_volume" :: held 0.776s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Created reservations ['dcff0a84-e192-43c7-8938-a85ccf9fa8d8', '51ffd565-5129-473f-b808-1677d9fce446', '2fae9761-6c25-4360-8fd6-6f36f58a6e62', 'fdbb947a-903e-4d3d-b352-ae9160921a0d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:23 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:23 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:23 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Deleted volume successfully. Nov 02 11:49:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ff0be16-b762-4212-862b-d2ba6a84a2d1 tempest-VolumesActionsTest-1255948252 None] Lock "cinder-d41f6094-30c4-4546-bba7-7a98626b2b7b-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-528b5d8e-6346-430c-9376-1ff336aa353a tempest-VolumesActionsTest-1350569994 None] Acquiring lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f" by "attach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-528b5d8e-6346-430c-9376-1ff336aa353a tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f" acquired by "attach_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-528b5d8e-6346-430c-9376-1ff336aa353a tempest-VolumesActionsTest-1350569994 None] Attaching volume fcc5b9b9-509f-4119-aee1-696ef77a999f to instance 5e1e22cc-9dda-4ea2-a49b-613e4a58d796 at mountpoint /dev/vdb on host None. Nov 02 11:49:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-528b5d8e-6346-430c-9376-1ff336aa353a tempest-VolumesActionsTest-1350569994 None] Attach volume completed successfully. Nov 02 11:49:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-528b5d8e-6346-430c-9376-1ff336aa353a tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f" released by "attach_volume" :: held 0.155s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Flow 'volume_create_manager' (994ee6a0-1347-48bf-a006-a1cb60ddbe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893858af-22ce-4c21-bd24-b116810cc528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893858af-22ce-4c21-bd24-b116810cc528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-722778760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99281b1b-a555-4bab-a645-dfbafdd221fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8a220f6884314833182832c4d577a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:34Z,use_quota=True,user_id='d1989f87b3104d05b928d539411db385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(840b1887-bca2-428c-8162-84873659e871),volume_type_id=840b1887-bca2-428c-8162-84873659e871)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb6de09-9482-4893-9211-aa6d34b1158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb6de09-9482-4893-9211-aa6d34b1158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef7c672-c193-45f6-9c24-2d310adc66bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef7c672-c193-45f6-9c24-2d310adc66bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99281b1b-a555-4bab-a645-dfbafdd221fc', 'volume_name': 'volume-99281b1b-a555-4bab-a645-dfbafdd221fc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8774622-3335-4d16-9daa-0c55f225c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8774622-3335-4d16-9daa-0c55f225c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e270e8bb-db5a-4924-8cd3-8e32304e5488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:33 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Volume 99281b1b-a555-4bab-a645-dfbafdd221fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99281b1b-a555-4bab-a645-dfbafdd221fc', 'volume_size': 1} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-722778760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99281b1b-a555-4bab-a645-dfbafdd221fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8a220f6884314833182832c4d577a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:34Z,use_quota=True,user_id='d1989f87b3104d05b928d539411db385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(840b1887-bca2-428c-8162-84873659e871),volume_type_id=840b1887-bca2-428c-8162-84873659e871)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Creating volume 99281b1b-a555-4bab-a645-dfbafdd221fc {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:49:33 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6fbb7238-3a04-4b9b-add0-7871d1606b18 tempest-VolumesActionsTest-1350569994 None] Acquiring lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-detach_volume" by "detach_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:33 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc 1073741824 Nov 02 11:49:33 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6fbb7238-3a04-4b9b-add0-7871d1606b18 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6fbb7238-3a04-4b9b-add0-7871d1606b18 tempest-VolumesActionsTest-1350569994 None] Detaching volume fcc5b9b9-509f-4119-aee1-696ef77a999f from instance 5e1e22cc-9dda-4ea2-a49b-613e4a58d796. Nov 02 11:49:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6fbb7238-3a04-4b9b-add0-7871d1606b18 tempest-VolumesActionsTest-1350569994 None] Detach volume completed successfully. Nov 02 11:49:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6fbb7238-3a04-4b9b-add0-7871d1606b18 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:34 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc 1073741824" returned: 0 in 1.072s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:34 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc Nov 02 11:49:34 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:35 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:49:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e270e8bb-db5a-4924-8cd3-8e32304e5488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99281b1b-a555-4bab-a645-dfbafdd221fc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cee345-e7e2-467d-8f75-8f2c359abb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Volume volume-99281b1b-a555-4bab-a645-dfbafdd221fc (99281b1b-a555-4bab-a645-dfbafdd221fc): created successfully Nov 02 11:49:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cee345-e7e2-467d-8f75-8f2c359abb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Flow 'volume_create_manager' (994ee6a0-1347-48bf-a006-a1cb60ddbe5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2a451a7e-9657-46b1-ad6f-1f8674b40870 tempest-VolumeTypesAccessTest-561478726 None] Created volume successfully. Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Acquiring lock "cinder-99281b1b-a555-4bab-a645-dfbafdd221fc-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Lock "cinder-99281b1b-a555-4bab-a645-dfbafdd221fc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Flow 'volume_create_manager' (743c6426-6363-4d67-b4ef-b966db8968dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4009789b-e1b8-4476-baba-6727b017c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4009789b-e1b8-4476-baba-6727b017c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1210735986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8598bc-1b40-4dff-a942-f41348dafe10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cd64d5719347518af74c62cfed5e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:36Z,use_quota=True,user_id='46bf61e44fc944608cf0017d2a68a11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbbdb31-ffa8-433c-9d58-6d7a727b5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbbdb31-ffa8-433c-9d58-6d7a727b5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad84cce-c91b-493b-b2aa-904a7c5dac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad84cce-c91b-493b-b2aa-904a7c5dac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8598bc-1b40-4dff-a942-f41348dafe10', 'volume_name': 'volume-ba8598bc-1b40-4dff-a942-f41348dafe10', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82345c7-27ff-4e6a-80e0-a526dfcfe97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82345c7-27ff-4e6a-80e0-a526dfcfe97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a839ea3-2f11-4359-a3cd-3f5914a8145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Volume ba8598bc-1b40-4dff-a942-f41348dafe10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8598bc-1b40-4dff-a942-f41348dafe10', 'volume_size': 1} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1210735986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8598bc-1b40-4dff-a942-f41348dafe10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cd64d5719347518af74c62cfed5e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:36Z,use_quota=True,user_id='46bf61e44fc944608cf0017d2a68a11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Creating volume ba8598bc-1b40-4dff-a942-f41348dafe10 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:49:36 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Acquiring lock "cinder-quobyte-99281b1b-a555-4bab-a645-dfbafdd221fc" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:36 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 1073741824 Nov 02 11:49:36 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Lock "cinder-quobyte-99281b1b-a555-4bab-a645-dfbafdd221fc" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47ccb53-7345-4a7c-90d4-f777e11c0ad4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:36 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc Nov 02 11:49:36 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:36 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 1073741824" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:36 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:36 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc Nov 02 11:49:36 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:36 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 Nov 02 11:49:36 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:37 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99281b1b-a555-4bab-a645-dfbafdd221fc" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Lock "cinder-quobyte-99281b1b-a555-4bab-a645-dfbafdd221fc" released by "delete_volume" :: held 0.875s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:37 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:37 devstack cinder-volume[86846]: WARNING cinder.quota [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1938034504 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1938034504, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:49:37 devstack cinder-volume[86846]: WARNING cinder.quota [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1938034504 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1938034504, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10" returned: 0 in 0.299s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a839ea3-2f11-4359-a3cd-3f5914a8145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8598bc-1b40-4dff-a942-f41348dafe10', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e6815b-30df-4a48-a41a-bbdf5878e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Created reservations ['361a3ca3-3ff7-4f97-b596-6fefb2041d34', '8b2fd703-e0cc-4ea1-aad8-10ed51c37f17', '81f6cbb9-7c41-4028-9ae6-69287ecd5500', '4e0d28cf-af3a-4498-9039-de9064e9cdd9'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Volume volume-ba8598bc-1b40-4dff-a942-f41348dafe10 (ba8598bc-1b40-4dff-a942-f41348dafe10): created successfully Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e6815b-30df-4a48-a41a-bbdf5878e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Flow 'volume_create_manager' (743c6426-6363-4d67-b4ef-b966db8968dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9310f81b-adcd-48fc-9b63-f96740b32859 tempest-VolumeQuotasAdminTestJSON-460387369 None] Created volume successfully. Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:37 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:37 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:37 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Deleted volume successfully. Nov 02 11:49:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ce744ae9-ad97-46e9-a32a-86061478f410 tempest-VolumeTypesAccessTest-561478726 None] Lock "cinder-99281b1b-a555-4bab-a645-dfbafdd221fc-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Acquiring lock "cinder-ba8598bc-1b40-4dff-a942-f41348dafe10-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "cinder-ba8598bc-1b40-4dff-a942-f41348dafe10-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Acquiring lock "cinder-quobyte-ba8598bc-1b40-4dff-a942-f41348dafe10" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "cinder-quobyte-ba8598bc-1b40-4dff-a942-f41348dafe10" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a49b1e9-cf3f-4797-af92-01a45b0eb7bd]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:38 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 Nov 02 11:49:38 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:38 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:38 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10 Nov 02 11:49:38 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:39 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ba8598bc-1b40-4dff-a942-f41348dafe10" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "cinder-quobyte-ba8598bc-1b40-4dff-a942-f41348dafe10" released by "delete_volume" :: held 0.843s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Created reservations ['c06327c1-0dc9-45bb-ad0f-6a0b9d51e5e1', '845000f7-8a02-4ce3-898e-d7c59279a98e', '8a314be4-c0cb-4144-b137-c4ff40631dc3', 'aa6322db-49d4-4b8a-8016-616269f3ebac'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:39 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:49:39 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:49:39 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ad1e7f-04b5-42d4-b796-98054b6dd300]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Deleted volume successfully. Nov 02 11:49:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e055ad29-ff45-4879-8994-b2c60b41986c tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "cinder-ba8598bc-1b40-4dff-a942-f41348dafe10-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:49:39 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:49:39 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Flow 'volume_create_manager' (418f6666-1564-43a5-8c9f-b76bbb21151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174d509a-f0db-4d0e-aa4d-b91f11187dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174d509a-f0db-4d0e-aa4d-b91f11187dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-836674248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cd64d5719347518af74c62cfed5e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:40Z,use_quota=True,user_id='46bf61e44fc944608cf0017d2a68a11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f799fa8-7092-4f34-8495-5ce12c648eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f799fa8-7092-4f34-8495-5ce12c648eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2062c9ca-01f6-4c1d-a90c-34f98da672ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2062c9ca-01f6-4c1d-a90c-34f98da672ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a', 'volume_name': 'volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d7e83-5844-4d12-ad74-7a7d3c906722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d7e83-5844-4d12-ad74-7a7d3c906722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01bd0a3-41eb-4ab8-9875-20619a492a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:40 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Volume b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a', 'volume_size': 1} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:40 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.547s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a5e33d-b3ee-4aa9-8228-b3040b30b027]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:40 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:49:40 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:40 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.b08bdcad-58a1-4550-bc94-87936887c0963p_3ds24.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:40 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.b08bdcad-58a1-4550-bc94-87936887c0963p_3ds24.img Nov 02 11:49:40 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:48 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.b08bdcad-58a1-4550-bc94-87936887c0963p_3ds24.img" returned: 0 in 8.109s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63900a3-1c7e-497f-8089-ed0aa936ed47]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:49:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:49:48 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:49:48 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:49:49 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Nov 02 11:49:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.548s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:49:49 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.b08bdcad-58a1-4550-bc94-87936887c0963p_3ds24.img {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:49:49 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Converted 1024.00 MB image at 126.24 MB/s Nov 02 11:49:49 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] b08bdcad-58a1-4550-bc94-87936887c096 was raw, no need to convert to raw {{(pid=86846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 11:49:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Flow 'volume_create_manager' (b4eac1dd-9383-4f36-9ce3-c18d984bd5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102d7bdd-dadb-4fac-ab29-91e68d965aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102d7bdd-dadb-4fac-ab29-91e68d965aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1982761969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372b35e6-2e14-4cae-a701-9af799431cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e76e57e57b4cb58d02499f50e39bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:50Z,use_quota=True,user_id='a6a7add24cb14de29988202b0c2c7503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049a2270-f283-4e7a-bac5-12ea4990bbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049a2270-f283-4e7a-bac5-12ea4990bbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f13e2eb-941d-4c7b-8cd8-23ae8783d05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f13e2eb-941d-4c7b-8cd8-23ae8783d05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372b35e6-2e14-4cae-a701-9af799431cd5', 'volume_name': 'volume-372b35e6-2e14-4cae-a701-9af799431cd5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e6a5f-22b5-4e32-a682-89ec4a5c243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350e6a5f-22b5-4e32-a682-89ec4a5c243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7acde8-f886-4f7b-acfd-a6c9f3f10562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Volume 372b35e6-2e14-4cae-a701-9af799431cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372b35e6-2e14-4cae-a701-9af799431cd5', 'volume_size': 1} Nov 02 11:49:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Flow 'volume_create_manager' (87a1876b-e5c4-42b9-b879-f8b88b34f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9fec81-1f43-43a7-a066-4509aef62b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9fec81-1f43-43a7-a066-4509aef62b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-446876827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aacb419-17e8-4d00-8c5c-2b081ba63fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968669b7431e48488112b45ae0750645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:57Z,use_quota=True,user_id='05322fc1777d4e03afa92e158b58bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f508b9-ca6e-4764-ac95-c27c26599f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f508b9-ca6e-4764-ac95-c27c26599f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e814ae-9443-43d0-93bf-897de9881a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e814ae-9443-43d0-93bf-897de9881a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aacb419-17e8-4d00-8c5c-2b081ba63fbe', 'volume_name': 'volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493e5541-0a4b-4007-a8fe-24eca5a37152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493e5541-0a4b-4007-a8fe-24eca5a37152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cb25e8-dd96-45e0-8256-fe34791d0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:49:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Volume 1aacb419-17e8-4d00-8c5c-2b081ba63fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe', 'volume_size': 1} Nov 02 11:49:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:07 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:INSERT=16,cinder:UPDATE=73,cinder:SELECT=64,cinder:DELETE=8 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:50:07 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=64,cinder:INSERT=19,cinder:UPDATE=80,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:50:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.349s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Uploaded volume to glance image-id: b08bdcad-58a1-4550-bc94-87936887c096. {{(pid=86846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.830s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-836674248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cd64d5719347518af74c62cfed5e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:40Z,use_quota=True,user_id='46bf61e44fc944608cf0017d2a68a11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Creating volume b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:08 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a 1073741824 Nov 02 11:50:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cc14d6ce-576e-46a1-b4ca-1c7b014c2534 tempest-VolumesActionsTest-1350569994 None] Copy volume to image completed successfully. Nov 02 11:50:08 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:08 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a 1073741824" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:08 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a Nov 02 11:50:08 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:08 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.654s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1982761969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372b35e6-2e14-4cae-a701-9af799431cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e76e57e57b4cb58d02499f50e39bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:50Z,use_quota=True,user_id='a6a7add24cb14de29988202b0c2c7503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Creating volume 372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:08 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 1073741824 Nov 02 11:50:08 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01bd0a3-41eb-4ab8-9875-20619a492a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c27092-41f5-4761-9be0-56442b9a47e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Volume volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a (b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a): created successfully Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c27092-41f5-4761-9be0-56442b9a47e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Flow 'volume_create_manager' (418f6666-1564-43a5-8c9f-b76bbb21151c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1884dd3c-7ab7-4847-8472-c70ee6e27bf3 tempest-VolumeQuotasAdminTestJSON-460387369 None] Created volume successfully. Nov 02 11:50:09 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 1073741824" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:09 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 Nov 02 11:50:09 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:09 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.348s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-446876827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aacb419-17e8-4d00-8c5c-2b081ba63fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968669b7431e48488112b45ae0750645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:49:57Z,use_quota=True,user_id='05322fc1777d4e03afa92e158b58bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Creating volume 1aacb419-17e8-4d00-8c5c-2b081ba63fbe {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:09 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:09 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe 1073741824 Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7acde8-f886-4f7b-acfd-a6c9f3f10562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372b35e6-2e14-4cae-a701-9af799431cd5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:09 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1581102a-77be-4692-b20a-192b6ac44689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Volume volume-372b35e6-2e14-4cae-a701-9af799431cd5 (372b35e6-2e14-4cae-a701-9af799431cd5): created successfully Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1581102a-77be-4692-b20a-192b6ac44689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Flow 'volume_create_manager' (b4eac1dd-9383-4f36-9ce3-c18d984bd5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eaf52f84-e069-4416-aa77-6721676bc123 tempest-SnapshotMetadataTestJSON-1077605040 None] Created volume successfully. Nov 02 11:50:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:10 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe 1073741824" returned: 0 in 0.528s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:10 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe Nov 02 11:50:10 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b8fb577a-d9aa-4049-b18b-538ed9b5f400 tempest-VolumeQuotasAdminTestJSON-1861346154 None] Transfer volume completed successfully. Nov 02 11:50:10 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.376s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79cb25e8-dd96-45e0-8256-fe34791d0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61cd6f6-7fb8-4851-b0dd-fed0906611a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf67243-ef6f-4b72-b288-bc5af611244e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Volume volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe (1aacb419-17e8-4d00-8c5c-2b081ba63fbe): created successfully Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61cd6f6-7fb8-4851-b0dd-fed0906611a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Flow 'volume_create_manager' (87a1876b-e5c4-42b9-b879-f8b88b34f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:10 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-18a15356-307e-45d6-b232-297d02dabae6 tempest-VolumesListAdminTestJSON-608856321 None] Created volume successfully. Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:10 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:50:10 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Acquiring lock "cinder-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Lock "cinder-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Acquiring lock "cinder-quobyte-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Lock "cinder-quobyte-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a642596-1ab9-4068-879b-9599d05b372d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:10 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[765005fb-154b-4f4d-a89c-81b9223d9649]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:10 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a Nov 02 11:50:10 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:10 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:50:10 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:11 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:11 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:11 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.381s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:11 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:11 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img Nov 02 11:50:11 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:11 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Lock "cinder-quobyte-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a" released by "delete_volume" :: held 0.698s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Created reservations ['b5197da0-882b-4b3c-a9ad-649556cb6ac6', 'bf956d62-e15d-4a29-bd8f-1604f154a4ff', 'a1c60cd5-e6ba-4f06-ae4f-f68f0953eac8', 'fcd7c40b-b9a0-4e29-9f55-8f392caf1bf0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:11 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:11 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Flow 'volume_create_manager' (52869be7-a112-46b3-b4dc-c882257a45f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdb1663-8cec-4d33-9d2a-a46065a6df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdb1663-8cec-4d33-9d2a-a46065a6df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-515727428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad906da-c6fa-4897-95f0-b9d3fa11f4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968669b7431e48488112b45ae0750645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:12Z,use_quota=True,user_id='05322fc1777d4e03afa92e158b58bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480bf698-2147-4045-8011-0dbe8ef4586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480bf698-2147-4045-8011-0dbe8ef4586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556245e3-68f7-4380-8d17-776ef7650c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556245e3-68f7-4380-8d17-776ef7650c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad906da-c6fa-4897-95f0-b9d3fa11f4f7', 'volume_name': 'volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffb3edd-9bd0-450f-bef8-a0b0c8827486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffb3edd-9bd0-450f-bef8-a0b0c8827486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef56e40-6659-4b1a-a6a2-8292144ab3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Volume 9ad906da-c6fa-4897-95f0-b9d3fa11f4f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7', 'volume_size': 1} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:12 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.604s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Deleted volume successfully. Nov 02 11:50:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f9c3230f-6747-437e-abb6-b26a2af0799f tempest-VolumeQuotasAdminTestJSON-249812232 None] Lock "cinder-b1de7a7a-ddd7-4d53-ad2c-c657063dfa0a-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:18 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img" returned: 0 in 7.658s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9f947e-eebc-4d70-89ab-f0496ae1efe9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:18 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:18 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:19 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:50:19 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:19 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:50:19 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.607s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:50:19 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Converted 1024.00 MB image at 133.67 MB/s Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] fd74eb3e-f828-465b-92d5-1e45b9c9888e was raw, converting to qcow2 {{(pid=86846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e79f986-d891-4016-83a3-252f9fecdce5]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:19 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img Nov 02 11:50:19 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:19 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:19 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img Nov 02 11:50:19 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:20 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img" returned: 1 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img /opt/stack/data/cinder/conversion/vol_upload_luru7cp2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:20 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img /opt/stack/data/cinder/conversion/vol_upload_luru7cp2 Nov 02 11:50:20 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:20 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img /opt/stack/data/cinder/conversion/vol_upload_luru7cp2" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Image conversion details: src /opt/stack/data/cinder/conversion/fcc5b9b9-509f-4119-aee1-696ef77a999f.temp_image.fd74eb3e-f828-465b-92d5-1e45b9c9888eroki6y09.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_luru7cp2 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:50:20 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c4c8f-e242-4250-8537-304f6450f358]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_luru7cp2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:20 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_luru7cp2 Nov 02 11:50:20 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:20 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_luru7cp2" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.065s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Uploaded volume to glance image-id: fd74eb3e-f828-465b-92d5-1e45b9c9888e. {{(pid=86846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.897s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Creating offline snapshot aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 of volume 372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:50:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1e056820-d924-4e0f-80a7-157e48ddbf26 tempest-VolumesActionsTest-1350569994 None] Copy volume to image completed successfully. Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3cfd0e-2664-4b83-af09-014460d1d511]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:22 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 Nov 02 11:50:22 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:22 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5" returned: 0 in 0.443s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:22 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 1G Nov 02 11:50:22 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:23 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 1G" returned: 0 in 0.466s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-372b35e6-2e14-4cae-a701-9af799431cd5 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:23 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-372b35e6-2e14-4cae-a701-9af799431cd5 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 Nov 02 11:50:23 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Acquiring lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:23 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-372b35e6-2e14-4cae-a701-9af799431cd5 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:23 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 is being set with open permissions: ugo+rw Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:23 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 Nov 02 11:50:23 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Acquiring lock "cinder-quobyte-fcc5b9b9-509f-4119-aee1-696ef77a999f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-quobyte-fcc5b9b9-509f-4119-aee1-696ef77a999f" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[571bbab9-f1bf-4a30-986d-40c6cde649ea]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:23 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:50:23 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:24 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:24 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.info Nov 02 11:50:24 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:24 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:24 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f Nov 02 11:50:24 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:24 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.info" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:24 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.info is being set with open permissions: ugo+rw Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:24 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.info Nov 02 11:50:24 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:24 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fcc5b9b9-509f-4119-aee1-696ef77a999f" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-quobyte-fcc5b9b9-509f-4119-aee1-696ef77a999f" released by "delete_volume" :: held 0.738s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Created reservations ['dc285ad1-9433-434a-b98c-b0e8a03ccdd2', 'de8fdab7-d485-44f6-885e-5f25e080e3d9', 'a9f8ad82-9593-47bb-a5e0-cdb91c99dc34', 'daed48fd-1e06-4cc4-9a40-3f8cee651208'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:24 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.info" returned: 0 in 0.306s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.679s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-515727428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad906da-c6fa-4897-95f0-b9d3fa11f4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968669b7431e48488112b45ae0750645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:12Z,use_quota=True,user_id='05322fc1777d4e03afa92e158b58bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Creating volume 9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:24 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:24 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 1073741824 Nov 02 11:50:24 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-34d0313f-614d-49bb-a0ae-b39f8d3a9800 tempest-SnapshotMetadataTestJSON-1077605040 None] Create snapshot completed successfully Nov 02 11:50:24 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:24 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:25 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Deleted volume successfully. Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-545469a5-006a-4d21-ab3d-baac574f3f04 tempest-VolumesActionsTest-1350569994 None] Lock "cinder-fcc5b9b9-509f-4119-aee1-696ef77a999f-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:25 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 1073741824" returned: 0 in 0.617s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:25 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 Nov 02 11:50:25 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:25 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef56e40-6659-4b1a-a6a2-8292144ab3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8e4440-4377-4371-bf77-988a2395b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Volume volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 (9ad906da-c6fa-4897-95f0-b9d3fa11f4f7): created successfully Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8e4440-4377-4371-bf77-988a2395b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Flow 'volume_create_manager' (52869be7-a112-46b3-b4dc-c882257a45f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ea7f155d-07c7-44ec-b480-6fa77bc573f3 tempest-VolumesListAdminTestJSON-608856321 None] Created volume successfully. Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "cinder-aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "cinder-quobyte-372b35e6-2e14-4cae-a701-9af799431cd5" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-quobyte-372b35e6-2e14-4cae-a701-9af799431cd5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "cinder-quobyte-aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-quobyte-aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Deleting offline snapshot aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 of volume 372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] snapshot_file for this snap is: volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d94b4eb-0ccd-4c47-a8a9-b9a94a722823]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:26 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 Nov 02 11:50:26 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:27 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" returned: 0 in 0.576s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-372b35e6-2e14-4cae-a701-9af799431cd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c827b-d9cf-4546-b794-949bb4ff4d71]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:27 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 Nov 02 11:50:27 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Flow 'volume_create_manager' (5087301d-7855-41de-8dcb-3b011fe129ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ba29a7-a7b0-426b-a0bf-d4f2a3247b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ba29a7-a7b0-426b-a0bf-d4f2a3247b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-712697783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968669b7431e48488112b45ae0750645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:28Z,use_quota=True,user_id='05322fc1777d4e03afa92e158b58bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4346a7-9612-47cf-b2d2-7e84fe1a94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4346a7-9612-47cf-b2d2-7e84fe1a94a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df01d45b-07ce-4b79-b21b-49af7a3a4cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df01d45b-07ce-4b79-b21b-49af7a3a4cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c', 'volume_name': 'volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef75b13-1343-48fd-a6a3-d89b789d05a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef75b13-1343-48fd-a6a3-d89b789d05a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aa654f-4c6c-4354-8baa-ad7975b4303f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Volume 9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c', 'volume_size': 1} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-712697783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968669b7431e48488112b45ae0750645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:28Z,use_quota=True,user_id='05322fc1777d4e03afa92e158b58bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Creating volume 9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:27 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:27 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c 1073741824 Nov 02 11:50:27 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:27 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5" returned: 0 in 0.655s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:28 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 Nov 02 11:50:28 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:28 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c 1073741824" returned: 0 in 0.591s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:28 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" returned: 0 in 0.457s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:28 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189 Nov 02 11:50:28 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:28 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c Nov 02 11:50:28 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:28 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5.aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:28 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-quobyte-aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189" released by "_delete_snapshot" :: held 2.115s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-quobyte-372b35e6-2e14-4cae-a701-9af799431cd5" released by "delete_snapshot" :: held 2.146s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aa654f-4c6c-4354-8baa-ad7975b4303f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596e167-9c00-467f-a461-6b3c100de344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Volume volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c (9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c): created successfully Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596e167-9c00-467f-a461-6b3c100de344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Flow 'volume_create_manager' (5087301d-7855-41de-8dcb-3b011fe129ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1ae69cde-0983-42af-aff4-8f8e7adccf9f tempest-VolumesListAdminTestJSON-608856321 None] Created volume successfully. Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Created reservations ['21c04f16-168d-4cfb-a069-8cf165e53f7b', '7d990bb2-4087-430d-90ce-a8ccae8b0d84', 'd60fcce7-17dd-474e-8d8d-a553c4d9b81e', 'ce7b9913-45bc-44b6-9099-8b6528177a5f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Delete snapshot completed successfully. Nov 02 11:50:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-969de02c-a04c-48b4-b9b2-c7ccbc52b9da tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-aa3da8c1-c7a5-4f16-9a31-bab5ec0cf189-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "cinder-372b35e6-2e14-4cae-a701-9af799431cd5-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-372b35e6-2e14-4cae-a701-9af799431cd5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "cinder-quobyte-372b35e6-2e14-4cae-a701-9af799431cd5" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-quobyte-372b35e6-2e14-4cae-a701-9af799431cd5" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee91188-446d-4a75-85fe-216e2196fd56]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:34 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 Nov 02 11:50:34 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:34 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5" returned: 0 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:34 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5 Nov 02 11:50:34 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:35 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-372b35e6-2e14-4cae-a701-9af799431cd5" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-quobyte-372b35e6-2e14-4cae-a701-9af799431cd5" released by "delete_volume" :: held 0.690s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Created reservations ['2952a3be-872b-4ac1-9fae-bfa7a911c7f0', '91c55459-a4ab-46e3-9ab5-c0353fd84337', '8eff86e2-7e9d-4797-b597-cc6a288f3198', '59ecac3a-6170-42c7-b4b5-4077a04ae91f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:36 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:36 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Flow 'volume_create_manager' (4b339c15-7948-45a9-8cc9-788693068c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f636e81-3512-4baf-8bdc-1a67d47f8cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f636e81-3512-4baf-8bdc-1a67d47f8cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980dbc61-03a5-479c-a87b-a4203baac163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9908554e3fb5409e8535c133fd6bde79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:36Z,use_quota=True,user_id='12de036f0d78454eaea4d6d406095dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:36 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac15715-7696-45fc-ac9a-fd96089df5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac15715-7696-45fc-ac9a-fd96089df5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd483b6-5bba-4598-b7d5-57277e518d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd483b6-5bba-4598-b7d5-57277e518d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980dbc61-03a5-479c-a87b-a4203baac163', 'volume_name': 'volume-980dbc61-03a5-479c-a87b-a4203baac163', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857ab337-4678-4304-bb0c-296bccfd2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857ab337-4678-4304-bb0c-296bccfd2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01996147-7823-43aa-992c-1b05074d7ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Volume 980dbc61-03a5-479c-a87b-a4203baac163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980dbc61-03a5-479c-a87b-a4203baac163', 'volume_size': 1} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980dbc61-03a5-479c-a87b-a4203baac163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9908554e3fb5409e8535c133fd6bde79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:36Z,use_quota=True,user_id='12de036f0d78454eaea4d6d406095dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Creating volume 980dbc61-03a5-479c-a87b-a4203baac163 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:36 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.519s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Deleted volume successfully. Nov 02 11:50:36 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 1073741824 Nov 02 11:50:36 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0d5aaec2-8d02-4123-bb23-115c6845ec81 tempest-SnapshotMetadataTestJSON-1077605040 None] Lock "cinder-372b35e6-2e14-4cae-a701-9af799431cd5-delete_volume" released by "delete_volume" :: held 4.728s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:37 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 1073741824" returned: 0 in 0.652s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:37 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 Nov 02 11:50:37 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:37 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01996147-7823-43aa-992c-1b05074d7ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980dbc61-03a5-479c-a87b-a4203baac163', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568eb258-fadd-4b4f-b312-f0e86072936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Volume volume-980dbc61-03a5-479c-a87b-a4203baac163 (980dbc61-03a5-479c-a87b-a4203baac163): created successfully Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568eb258-fadd-4b4f-b312-f0e86072936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Flow 'volume_create_manager' (4b339c15-7948-45a9-8cc9-788693068c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cf75b269-6dcf-48c2-a9a4-be15fab0af15 tempest-VolumesListAdminTestJSON-1538667170 None] Created volume successfully. Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Acquiring lock "cinder-980dbc61-03a5-479c-a87b-a4203baac163-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Lock "cinder-980dbc61-03a5-479c-a87b-a4203baac163-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Acquiring lock "cinder-quobyte-980dbc61-03a5-479c-a87b-a4203baac163" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Lock "cinder-quobyte-980dbc61-03a5-479c-a87b-a4203baac163" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1c99ec-cd1b-49c3-8a97-39512d222a0d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "cinder-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "cinder-quobyte-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-quobyte-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b6927-ac2b-422d-9488-21603a8d76fb]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:38 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 Nov 02 11:50:38 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:39 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c Nov 02 11:50:39 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:39 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163" returned: 0 in 0.528s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:39 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163 Nov 02 11:50:39 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:39 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c" returned: 0 in 0.452s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:39 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c Nov 02 11:50:39 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:39 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-980dbc61-03a5-479c-a87b-a4203baac163" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Lock "cinder-quobyte-980dbc61-03a5-479c-a87b-a4203baac163" released by "delete_volume" :: held 0.889s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:39 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-quobyte-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c" released by "delete_volume" :: held 0.795s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Created reservations ['a0421d29-becb-4e0d-b29e-2dbf56d8dd35', 'a49eb4c6-40bc-404c-8634-9ba4cf6cd67e', 'ae36b9af-74c7-4076-9ced-1ce771924c76', '7114150d-e483-44cf-8221-c0a8e2444b94'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Created reservations ['1c5d4132-8cec-4060-a470-8a5e496abe30', '160412be-afda-4f64-8c5d-8ce994737f16', 'ef5f5dd9-01d7-4335-8871-59daa3572825', '7b1d0bfb-1ae6-403b-bdb7-7115b703cd35'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:39 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:39 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:39 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:39 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:40 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Deleted volume successfully. Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0354839-fb18-4d4a-ad23-67c122e758dc tempest-VolumesListAdminTestJSON-1538667170 None] Lock "cinder-980dbc61-03a5-479c-a87b-a4203baac163-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:40 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.414s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Deleted volume successfully. Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b9cb036-6357-44b5-8934-1f84160c50fa tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-9b09fd10-b00e-4b94-bbd9-d0e01ae6fb2c-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "cinder-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "cinder-quobyte-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-quobyte-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e201ace-4dbb-43e5-a3c3-aecd0fa6efff]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:40 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 Nov 02 11:50:40 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:40 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:41 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7 Nov 02 11:50:41 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:41 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7" returned: 0 in 0.313s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-quobyte-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7" released by "delete_volume" :: held 0.807s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Created reservations ['ca5bb312-74f5-41f4-85bf-6e236a3022bc', '66f8b222-f381-4e20-809c-4f6e8432ffe1', '0e83cf06-509d-471b-8c47-382d3205ac8f', '2210c405-a455-4602-9cf6-a1bf64fccd63'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:41 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:41 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "cinder-1aacb419-17e8-4d00-8c5c-2b081ba63fbe-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-1aacb419-17e8-4d00-8c5c-2b081ba63fbe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:41 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.385s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:41 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Deleted volume successfully. Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "cinder-quobyte-1aacb419-17e8-4d00-8c5c-2b081ba63fbe" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Flow 'volume_create_manager' (c899dd89-932b-407a-a89f-d7685bca54d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a062a03d-9a87-435e-8c67-d0977508434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0bcd8c2c-6ce9-473f-8a37-acd99c327945 tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-9ad906da-c6fa-4897-95f0-b9d3fa11f4f7-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-quobyte-1aacb419-17e8-4d00-8c5c-2b081ba63fbe" acquired by "delete_volume" :: waited 0.054s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a062a03d-9a87-435e-8c67-d0977508434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1043296005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2770004b-fabe-4122-b224-d7a92449f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c1e23f38744acfbaeb92f416b3cc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:42Z,use_quota=True,user_id='76dafa35105c43a99dc60e17d21a074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea87b70-5802-44ce-b54d-fac88e6348f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea87b70-5802-44ce-b54d-fac88e6348f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba97f1-9006-4393-93d5-8fd6b0f1b209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf3c438-a0be-4494-9569-cc663c06edb0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:42 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe Nov 02 11:50:42 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ba97f1-9006-4393-93d5-8fd6b0f1b209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2770004b-fabe-4122-b224-d7a92449f21f', 'volume_name': 'volume-2770004b-fabe-4122-b224-d7a92449f21f', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019c8507-af18-4c76-8e55-f246a7073804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019c8507-af18-4c76-8e55-f246a7073804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da730f1-faff-4728-853d-c46d6fd3beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Volume 2770004b-fabe-4122-b224-d7a92449f21f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2770004b-fabe-4122-b224-d7a92449f21f', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Trying to clone 2770004b-fabe-4122-b224-d7a92449f21f from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:50:42 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe" returned: 0 in 0.620s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:42 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe Nov 02 11:50:42 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:50:43 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Image download 20.69 MB at 20.69 MB/s Nov 02 11:50:43 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1aacb419-17e8-4d00-8c5c-2b081ba63fbe" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-quobyte-1aacb419-17e8-4d00-8c5c-2b081ba63fbe" released by "delete_volume" :: held 1.044s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d6b366-10c1-415d-90c4-286bf19dcb49]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Created reservations ['46699f1c-c62c-4496-96b8-4c08a9a747a5', '56866531-7057-4f08-8820-755dca07980f', '3393993b-2572-4915-8e2b-2c92d7c40f8e', '381c9a84-2e23-44fe-bf85-e5b42c0da9e7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:43 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD Nov 02 11:50:43 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:43 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:43 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:43 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 is fetched for user 76dafa35105c43a99dc60e17d21a074e. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:50:43 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac0109-b023-44ae-9133-c92cfeff524f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Deleted volume successfully. Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-90c74c6f-3ea6-4c02-8292-5e1ec836643e tempest-VolumesListAdminTestJSON-608856321 None] Lock "cinder-1aacb419-17e8-4d00-8c5c-2b081ba63fbe-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:43 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD Nov 02 11:50:43 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:43 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Flow 'volume_create_manager' (b38557f1-1fd6-4751-b8e9-6540437cf94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fb44cd-d883-4bbc-aba9-8ea0c3f1fadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fb44cd-d883-4bbc-aba9-8ea0c3f1fadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1939390002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9549e2ca-2c7c-45f7-b08e-49ab1e1c5894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1da4ec954b40b1a5b2b408f0d3bc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:44Z,use_quota=True,user_id='80b3f1db6d7c4f93ab2d437a9e71f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58f5fcb-8898-452f-b9a3-7a11d2066c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58f5fcb-8898-452f-b9a3-7a11d2066c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a4821c-ed7f-4e04-804e-cb503ebfdfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a4821c-ed7f-4e04-804e-cb503ebfdfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9549e2ca-2c7c-45f7-b08e-49ab1e1c5894', 'volume_name': 'volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9dd377-33cf-4a6f-892c-8dc8af7ed00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9dd377-33cf-4a6f-892c-8dc8af7ed00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:44 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388248e9-6e76-4cfc-8be7-3e6bf0c96a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Volume 9549e2ca-2c7c-45f7-b08e-49ab1e1c5894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894', 'volume_size': 1} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1939390002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9549e2ca-2c7c-45f7-b08e-49ab1e1c5894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1da4ec954b40b1a5b2b408f0d3bc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:44Z,use_quota=True,user_id='80b3f1db6d7c4f93ab2d437a9e71f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Creating volume 9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:44 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 1073741824 Nov 02 11:50:44 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:44 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 1073741824" returned: 0 in 0.510s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:44 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 Nov 02 11:50:44 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:44 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894" returned: 0 in 0.280s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1043296005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2770004b-fabe-4122-b224-d7a92449f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c1e23f38744acfbaeb92f416b3cc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:42Z,use_quota=True,user_id='76dafa35105c43a99dc60e17d21a074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Creating volume 2770004b-fabe-4122-b224-d7a92449f21f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388248e9-6e76-4cfc-8be7-3e6bf0c96a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0672eb0d-66d2-4ace-987a-c8d1e9622ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:45 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f 1073741824 Nov 02 11:50:45 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Volume volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 (9549e2ca-2c7c-45f7-b08e-49ab1e1c5894): created successfully Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0672eb0d-66d2-4ace-987a-c8d1e9622ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Flow 'volume_create_manager' (b38557f1-1fd6-4751-b8e9-6540437cf94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-30caf002-b075-4ca0-add7-f4f44e9ceb26 tempest-VolumesTransfersTest-1454473310 None] Created volume successfully. Nov 02 11:50:45 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f 1073741824" returned: 0 in 0.584s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:45 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f Nov 02 11:50:45 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Flow 'volume_create_manager' (0403047f-72fc-4b88-975e-ebe62209e4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573264cd-506d-4e49-8d9c-3591eece6729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573264cd-506d-4e49-8d9c-3591eece6729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1964889965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe6b9f7-abb4-4459-9d77-1a0e565a5431,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='849fa1dce01d4788b577d9f85f523ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:46Z,use_quota=True,user_id='c96d0cc24e35433a8e15ca68d6ba2682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae833d2-1755-4a2a-b99f-082ac2ff65b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae833d2-1755-4a2a-b99f-082ac2ff65b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbb4251-a647-46b1-b0e3-abddf5b7fe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbb4251-a647-46b1-b0e3-abddf5b7fe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe6b9f7-abb4-4459-9d77-1a0e565a5431', 'volume_name': 'volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97aa0318-8d1d-4e13-9bb3-82938ab2721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97aa0318-8d1d-4e13-9bb3-82938ab2721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ee2c81-fccf-4864-a7b1-02abf06381b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Volume 3fe6b9f7-abb4-4459-9d77-1a0e565a5431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431', 'volume_size': 1} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:45 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1964889965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe6b9f7-abb4-4459-9d77-1a0e565a5431,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='849fa1dce01d4788b577d9f85f523ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:46Z,use_quota=True,user_id='c96d0cc24e35433a8e15ca68d6ba2682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Creating volume 3fe6b9f7-abb4-4459-9d77-1a0e565a5431 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:45 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:45 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 1073741824 Nov 02 11:50:45 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:45 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Attempting download of 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 2770004b-fabe-4122-b224-d7a92449f21f. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2758aa-d738-4b62-ad17-ef3410d6c4bb]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_na4fi537 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:46 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_na4fi537 Nov 02 11:50:46 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:46 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_na4fi537" returned: 0 in 0.475s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_na4fi537 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:46 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 1073741824" returned: 0 in 0.614s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:46 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 Nov 02 11:50:46 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:46 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_na4fi537 Nov 02 11:50:46 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:46 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431" returned: 0 in 0.283s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ee2c81-fccf-4864-a7b1-02abf06381b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5800c7-8d36-4a18-b047-0555334d1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Volume volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 (3fe6b9f7-abb4-4459-9d77-1a0e565a5431): created successfully Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5800c7-8d36-4a18-b047-0555334d1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Flow 'volume_create_manager' (0403047f-72fc-4b88-975e-ebe62209e4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bcd0296f-1ce4-4c36-9dc5-30c7652282e5 tempest-VolumesListTestJSON-2146179202 None] Created volume successfully. Nov 02 11:50:46 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_na4fi537" returned: 1 in 0.457s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_na4fi537' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d303e-b688-481b-9b18-bc940ff3db13]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:47 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD Nov 02 11:50:47 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4adc70e0-953c-4ef3-9e73-91dc3ee4cf50 tempest-VolumesTransfersTest-787746150 None] Transfer volume completed successfully. Nov 02 11:50:47 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:47 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:50:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:47 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f Nov 02 11:50:47 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Acquiring lock "cinder-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Acquiring lock "cinder-quobyte-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-quobyte-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f627d2-032e-4268-b421-3423ceab51a3]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:48 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 Nov 02 11:50:48 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Flow 'volume_create_manager' (b97b5cf1-df53-455d-8100-17f4fa9e68f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b857f5f-86f5-47b2-a6c3-21d1d639704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b857f5f-86f5-47b2-a6c3-21d1d639704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1787138591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18deaf3-fb1b-43e8-ae8c-0602e5748817,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='849fa1dce01d4788b577d9f85f523ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:48Z,use_quota=True,user_id='c96d0cc24e35433a8e15ca68d6ba2682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f572b7a-bf97-457e-9b17-47cf4cf52cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f572b7a-bf97-457e-9b17-47cf4cf52cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba59abcd-0868-47df-b689-9cabba1256ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba59abcd-0868-47df-b689-9cabba1256ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c18deaf3-fb1b-43e8-ae8c-0602e5748817', 'volume_name': 'volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2350f5-8855-4d0e-b823-83aba20bfd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2350f5-8855-4d0e-b823-83aba20bfd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972b45-cea7-4ce7-826d-dd1642aa7753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Volume c18deaf3-fb1b-43e8-ae8c-0602e5748817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817', 'volume_size': 1} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1787138591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18deaf3-fb1b-43e8-ae8c-0602e5748817,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='849fa1dce01d4788b577d9f85f523ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:48Z,use_quota=True,user_id='c96d0cc24e35433a8e15ca68d6ba2682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Creating volume c18deaf3-fb1b-43e8-ae8c-0602e5748817 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:48 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 1073741824 Nov 02 11:50:48 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:48 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894" returned: 0 in 0.543s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:48 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894 Nov 02 11:50:48 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:49 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-quobyte-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894" released by "delete_volume" :: held 0.910s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Created reservations ['e1fd5530-9dbe-419f-aa5b-651593f2bf31', '29e2071d-f085-4494-8ce2-db5179c8cb01', 'b421283d-b7b3-48b5-a384-f66b8d5f1faa', '4eccf8e7-a942-4c82-98a1-0535f1c0de7f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:49 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:49 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:49 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 1073741824" returned: 0 in 0.647s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:49 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 Nov 02 11:50:49 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:49 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Deleted volume successfully. Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a75dfce2-a9a6-475c-b4e8-099b13109b5e tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-9549e2ca-2c7c-45f7-b08e-49ab1e1c5894-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:49 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972b45-cea7-4ce7-826d-dd1642aa7753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b8b53c-83a0-4a00-95db-20d429208a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Volume volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 (c18deaf3-fb1b-43e8-ae8c-0602e5748817): created successfully Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b8b53c-83a0-4a00-95db-20d429208a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Flow 'volume_create_manager' (b97b5cf1-df53-455d-8100-17f4fa9e68f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1b5cc386-45d2-43e9-bb23-f75c003f4586 tempest-VolumesListTestJSON-2146179202 None] Created volume successfully. Nov 02 11:50:49 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f" returned: 0 in 2.517s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_86au8qvzdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:50:49 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Converted 112.00 MB image at 44.49 MB/s Nov 02 11:50:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:49 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f 1G Nov 02 11:50:49 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:50 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f 1G" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Downloaded image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 2770004b-fabe-4122-b224-d7a92449f21f successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 for user 76dafa35105c43a99dc60e17d21a074e is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Marking volume 2770004b-fabe-4122-b224-d7a92449f21f as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Copying metadata from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 to 2770004b-fabe-4122-b224-d7a92449f21f. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Creating volume glance metadata for volume 2770004b-fabe-4122-b224-d7a92449f21f backed by image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da730f1-faff-4728-853d-c46d6fd3beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2770004b-fabe-4122-b224-d7a92449f21f', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eddbc89-5145-4e6e-8dd6-89ec115c2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Volume volume-2770004b-fabe-4122-b224-d7a92449f21f (2770004b-fabe-4122-b224-d7a92449f21f): created successfully Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eddbc89-5145-4e6e-8dd6-89ec115c2621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Flow 'volume_create_manager' (c899dd89-932b-407a-a89f-d7685bca54d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1bbed6fd-169e-47d4-bd3b-7037030f3602 tempest-VolumesImageMetadata-719642267 None] Created volume successfully. Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Flow 'volume_create_manager' (a412d051-273c-40e7-b0f0-4fa58388e83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5baae63-53db-48ac-8258-7a3d7b4575d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5baae63-53db-48ac-8258-7a3d7b4575d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-63590048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d636a265-6723-4618-89f8-4822f2d18328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7fec07d108417cb26df2e2c35fee93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:50Z,use_quota=True,user_id='520b58237b2b4c768e01baf0fd31fa21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c149ac6c-ff60-4dfc-a134-a74ff12151d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c149ac6c-ff60-4dfc-a134-a74ff12151d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e21e917-caec-473f-b72f-2398512bb24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e21e917-caec-473f-b72f-2398512bb24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd636a265-6723-4618-89f8-4822f2d18328', 'volume_name': 'volume-d636a265-6723-4618-89f8-4822f2d18328', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62ab6d5-3971-4664-a447-3533873cc4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62ab6d5-3971-4664-a447-3533873cc4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58025df4-7182-4687-ba13-ae8ec839b8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Volume d636a265-6723-4618-89f8-4822f2d18328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d636a265-6723-4618-89f8-4822f2d18328', 'volume_size': 1} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-63590048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d636a265-6723-4618-89f8-4822f2d18328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7fec07d108417cb26df2e2c35fee93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:50Z,use_quota=True,user_id='520b58237b2b4c768e01baf0fd31fa21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Creating volume d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:50 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:50 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 1073741824 Nov 02 11:50:50 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Flow 'volume_create_manager' (fc5c6c83-df17-44e9-8501-1f48c6bb8f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e7c2f-2f7a-451b-89f1-c33dd1ae2af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e7c2f-2f7a-451b-89f1-c33dd1ae2af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-217828543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a93440-c7da-41e4-9899-af4d9bc3f15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1da4ec954b40b1a5b2b408f0d3bc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:51Z,use_quota=True,user_id='80b3f1db6d7c4f93ab2d437a9e71f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e68c24-50fe-4f32-bed7-e1db18c75b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e68c24-50fe-4f32-bed7-e1db18c75b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc7c64e-b1e7-49da-b7d7-bf6f58067740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc7c64e-b1e7-49da-b7d7-bf6f58067740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a93440-c7da-41e4-9899-af4d9bc3f15d', 'volume_name': 'volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da391070-e32d-4d37-a021-0d3838658d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da391070-e32d-4d37-a021-0d3838658d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af460507-211c-4447-bb12-dc43c01a1ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Volume b3a93440-c7da-41e4-9899-af4d9bc3f15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d', 'volume_size': 1} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:51 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 1073741824" returned: 0 in 0.595s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Acquiring lock "cinder-2770004b-fabe-4122-b224-d7a92449f21f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Lock "cinder-2770004b-fabe-4122-b224-d7a92449f21f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:51 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 Nov 02 11:50:51 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Acquiring lock "cinder-quobyte-2770004b-fabe-4122-b224-d7a92449f21f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Lock "cinder-quobyte-2770004b-fabe-4122-b224-d7a92449f21f" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8da346-a09f-465c-86de-c49191e78b46]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Flow 'volume_create_manager' (1b54d91d-3b56-4712-b111-86d9506f29eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd4198-e8b6-4f74-86a4-c9879f8990e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd4198-e8b6-4f74-86a4-c9879f8990e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-669157118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e69051-44d8-4c26-82bb-cb9b2015024d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='849fa1dce01d4788b577d9f85f523ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:51Z,use_quota=True,user_id='c96d0cc24e35433a8e15ca68d6ba2682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bb1f56-7935-4af6-94a7-e4045833bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bb1f56-7935-4af6-94a7-e4045833bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a4efa2-086c-4901-9e29-961c60d34df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a4efa2-086c-4901-9e29-961c60d34df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e69051-44d8-4c26-82bb-cb9b2015024d', 'volume_name': 'volume-a9e69051-44d8-4c26-82bb-cb9b2015024d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bc2b26-1563-4f20-81e2-2b2ec1cb4b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bc2b26-1563-4f20-81e2-2b2ec1cb4b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fbe9fb-29ee-4078-8a8c-5b7fbbc2b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Volume a9e69051-44d8-4c26-82bb-cb9b2015024d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e69051-44d8-4c26-82bb-cb9b2015024d', 'volume_size': 1} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:51 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f Nov 02 11:50:51 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:51 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328" returned: 0 in 0.312s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-217828543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a93440-c7da-41e4-9899-af4d9bc3f15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1da4ec954b40b1a5b2b408f0d3bc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:51Z,use_quota=True,user_id='80b3f1db6d7c4f93ab2d437a9e71f516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Creating volume b3a93440-c7da-41e4-9899-af4d9bc3f15d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:51 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:51 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d 1073741824 Nov 02 11:50:51 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58025df4-7182-4687-ba13-ae8ec839b8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d636a265-6723-4618-89f8-4822f2d18328', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee2281f-992d-4b0e-9d63-7a7cfc0dd531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Volume volume-d636a265-6723-4618-89f8-4822f2d18328 (d636a265-6723-4618-89f8-4822f2d18328): created successfully Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee2281f-992d-4b0e-9d63-7a7cfc0dd531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Flow 'volume_create_manager' (a412d051-273c-40e7-b0f0-4fa58388e83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2db8d7b5-20bd-4e84-a68c-df9b21708c54 tempest-VolumesDeleteCascade-1458560409 None] Created volume successfully. Nov 02 11:50:51 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:51 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f Nov 02 11:50:51 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:52 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d 1073741824" returned: 0 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:52 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2770004b-fabe-4122-b224-d7a92449f21f" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Lock "cinder-quobyte-2770004b-fabe-4122-b224-d7a92449f21f" released by "delete_volume" :: held 0.740s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:52 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d Nov 02 11:50:52 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Created reservations ['5c4b6d3e-42e5-4e73-ad2f-fe8a2f37ff63', 'ad6dcf63-74ee-42c5-b8ed-404940c33bfb', '13cca7a7-5758-463c-8d8c-8c9591660dcc', '7dc24bba-97f4-4742-b271-1c86dbd520da'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:52 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:52 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:52 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-669157118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e69051-44d8-4c26-82bb-cb9b2015024d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='849fa1dce01d4788b577d9f85f523ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:50:51Z,use_quota=True,user_id='c96d0cc24e35433a8e15ca68d6ba2682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Creating volume a9e69051-44d8-4c26-82bb-cb9b2015024d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:50:52 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af460507-211c-4447-bb12-dc43c01a1ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbbdd78-7c99-4527-9bfa-6ef6784bf043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:52 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d 1073741824 Nov 02 11:50:52 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:52 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Volume volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d (b3a93440-c7da-41e4-9899-af4d9bc3f15d): created successfully Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbbdd78-7c99-4527-9bfa-6ef6784bf043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Flow 'volume_create_manager' (fc5c6c83-df17-44e9-8501-1f48c6bb8f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-67a8d955-0e31-40b9-a801-1db2da5ebf2b tempest-VolumesTransfersTest-1454473310 None] Created volume successfully. Nov 02 11:50:52 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.306s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Deleted volume successfully. Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d73acf03-933b-42a4-9994-b289fbf3fcbb tempest-VolumesImageMetadata-719642267 None] Lock "cinder-2770004b-fabe-4122-b224-d7a92449f21f-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:52 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d 1073741824" returned: 0 in 0.533s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:52 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d Nov 02 11:50:52 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:53 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d" returned: 0 in 0.261s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.399s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fbe9fb-29ee-4078-8a8c-5b7fbbc2b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e69051-44d8-4c26-82bb-cb9b2015024d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2506001-285c-4306-8c62-e17ebeac73ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Creating offline snapshot 86222734-4c10-46f8-9840-a18a046e0eea of volume d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:50:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Volume volume-a9e69051-44d8-4c26-82bb-cb9b2015024d (a9e69051-44d8-4c26-82bb-cb9b2015024d): created successfully Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2506001-285c-4306-8c62-e17ebeac73ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Flow 'volume_create_manager' (1b54d91d-3b56-4712-b111-86d9506f29eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[206d7905-afd9-48a9-afbf-de1d99581884]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0614729a-27e9-4cff-a81b-9cfd542d18cf tempest-VolumesListTestJSON-2146179202 None] Created volume successfully. Nov 02 11:50:53 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 Nov 02 11:50:53 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Acquiring lock "cinder-b3a93440-c7da-41e4-9899-af4d9bc3f15d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-b3a93440-c7da-41e4-9899-af4d9bc3f15d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Acquiring lock "cinder-quobyte-b3a93440-c7da-41e4-9899-af4d9bc3f15d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-quobyte-b3a93440-c7da-41e4-9899-af4d9bc3f15d" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d88d2-8c3d-4a2e-b119-f03ba9dc2e64]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:53 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328" returned: 0 in 0.499s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:53 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea 1G Nov 02 11:50:53 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:53 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d Nov 02 11:50:53 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:54 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d" returned: 0 in 0.498s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:54 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d Nov 02 11:50:54 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:54 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea 1G" returned: 0 in 0.597s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:54 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea Nov 02 11:50:54 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:54 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3a93440-c7da-41e4-9899-af4d9bc3f15d" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-quobyte-b3a93440-c7da-41e4-9899-af4d9bc3f15d" released by "delete_volume" :: held 0.917s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Created reservations ['a3ba9cd9-d6ca-4440-a8f5-d86ca64e9bd7', 'd5cf4b84-e84c-4541-a812-edd3d5017fee', 'ad9e59f1-fe0a-4d52-a968-272ef50f6c89', 'bc01eae9-e613-4678-a81d-c92bd2d33cea'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:54 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:54 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea is being set with open permissions: ugo+rw Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:54 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea Nov 02 11:50:54 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:54 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:54 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:55 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:55 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:55 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.info Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.315s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:55 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Deleted volume successfully. Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6a5f4e59-f8d9-4866-acc0-e2ae9f61bca6 tempest-VolumesTransfersTest-1608423076 None] Lock "cinder-b3a93440-c7da-41e4-9899-af4d9bc3f15d-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:55 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.info" returned: 0 in 0.307s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:55 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.info is being set with open permissions: ugo+rw Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:55 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.info Nov 02 11:50:55 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:55 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.info" returned: 0 in 0.261s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0e918401-771c-40f3-8039-18f0e239fc13 tempest-VolumesDeleteCascade-1458560409 None] Create snapshot completed successfully Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Creating offline snapshot e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 of volume d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c425d7a-e59f-442b-baa5-fa6c56277236]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:56 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea Nov 02 11:50:56 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "cinder-a9e69051-44d8-4c26-82bb-cb9b2015024d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-a9e69051-44d8-4c26-82bb-cb9b2015024d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "cinder-quobyte-a9e69051-44d8-4c26-82bb-cb9b2015024d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-quobyte-a9e69051-44d8-4c26-82bb-cb9b2015024d" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd9441-df3a-4dab-8b96-5372389c0308]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:56 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d Nov 02 11:50:56 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:56 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea" returned: 0 in 0.539s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d636a265-6723-4618-89f8-4822f2d18328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:50:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:56 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 1G Nov 02 11:50:56 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:57 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d" returned: 0 in 0.449s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:57 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d Nov 02 11:50:57 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:57 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a9e69051-44d8-4c26-82bb-cb9b2015024d" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-quobyte-a9e69051-44d8-4c26-82bb-cb9b2015024d" released by "delete_volume" :: held 0.804s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:57 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 1G" returned: 0 in 0.612s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:57 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 Nov 02 11:50:57 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Created reservations ['0cb30576-9830-4808-94d7-ce0492f6d89f', '78cfdf64-2b52-474d-8f34-fdc7f68e5bcd', '6efcda87-05e7-43af-92a7-19c9479ae848', '3b650e8b-bd38-442c-9bb8-e4f354487262'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:57 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:57 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "cinder-c18deaf3-fb1b-43e8-ae8c-0602e5748817-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-c18deaf3-fb1b-43e8-ae8c-0602e5748817-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:57 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:57 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:58 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Deleted volume successfully. Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" returned: 0 in 0.537s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 is being set with open permissions: ugo+rw Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:58 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "cinder-quobyte-c18deaf3-fb1b-43e8-ae8c-0602e5748817" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:58 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3b3b2199-08ca-4fd1-9ce5-8ac2cc2886e6 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-a9e69051-44d8-4c26-82bb-cb9b2015024d-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-quobyte-c18deaf3-fb1b-43e8-ae8c-0602e5748817" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[302e683c-f5d0-4842-bfda-bcfd406a4b1c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:58 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 Nov 02 11:50:58 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:58 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" returned: 0 in 0.365s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cd36462f-7bcb-4760-9c36-a4fe4811a01f tempest-VolumesDeleteCascade-1458560409 None] Create snapshot completed successfully Nov 02 11:50:58 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817" returned: 0 in 0.469s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:58 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817 Nov 02 11:50:58 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:58 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c18deaf3-fb1b-43e8-ae8c-0602e5748817" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-quobyte-c18deaf3-fb1b-43e8-ae8c-0602e5748817" released by "delete_volume" :: held 0.832s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:58 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Created reservations ['80b4b6e9-2f47-45d8-8ded-6795bb10af58', 'fce4d8a7-6c0b-42cb-9ded-2d2e8c49b357', '1a5d7124-eb80-49ef-9645-f8438e54fa8b', 'a40f7f72-0152-45cb-b21f-ead0e5a7f919'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:59 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:50:59 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "cinder-3fe6b9f7-abb4-4459-9d77-1a0e565a5431-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-3fe6b9f7-abb4-4459-9d77-1a0e565a5431-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "cinder-quobyte-3fe6b9f7-abb4-4459-9d77-1a0e565a5431" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-quobyte-3fe6b9f7-abb4-4459-9d77-1a0e565a5431" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b062c66-554e-41ea-b4ec-6363f625ae6e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:59 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:50:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Deleted volume successfully. Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82513f60-96d7-4a1b-958d-c2fdcbd9e107 tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-c18deaf3-fb1b-43e8-ae8c-0602e5748817-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-d636a265-6723-4618-89f8-4822f2d18328-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-d636a265-6723-4618-89f8-4822f2d18328-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:59 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 Nov 02 11:50:59 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Performing cascade delete. {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-86222734-4c10-46f8-9840-a18a046e0eea-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-86222734-4c10-46f8-9840-a18a046e0eea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-86222734-4c10-46f8-9840-a18a046e0eea" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-86222734-4c10-46f8-9840-a18a046e0eea" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Deleting offline snapshot 86222734-4c10-46f8-9840-a18a046e0eea of volume d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] snapshot_file for this snap is: volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4043e5d8-6d61-45ed-8e67-58f99686c2cb]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:50:59 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea Nov 02 11:50:59 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:50:59 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431" returned: 0 in 0.530s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:50:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:00 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431 Nov 02 11:51:00 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:00 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d636a265-6723-4618-89f8-4822f2d18328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd658c-8789-40e2-b348-f03c140a8da5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:00 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3fe6b9f7-abb4-4459-9d77-1a0e565a5431" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-quobyte-3fe6b9f7-abb4-4459-9d77-1a0e565a5431" released by "delete_volume" :: held 0.974s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Created reservations ['ab851233-0446-4f2a-9bca-0816a077ce40', '8d9cb6d9-2361-4990-b568-457d43572f53', 'a0cb9551-e3a6-40c4-880b-0794201db121', '2aa7d015-c777-4346-9995-6e72ef9deba7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:00 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 Nov 02 11:51:00 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:00 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:00 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:00 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328" returned: 0 in 0.490s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:00 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95d7b4-5a29-47a9-9b1a-975f9a802113]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Deleted volume successfully. Nov 02 11:51:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-11b15d18-dc1e-4e3a-aef8-031c8a203b7c tempest-VolumesListTestJSON-2146179202 None] Lock "cinder-3fe6b9f7-abb4-4459-9d77-1a0e565a5431-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:01 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 Nov 02 11:51:01 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:01 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" returned: 0 in 0.429s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d636a265-6723-4618-89f8-4822f2d18328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe89d2-a6f1-47ba-ae83-6910acf59d54]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:01 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea Nov 02 11:51:01 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:01 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d636a265-6723-4618-89f8-4822f2d18328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b3331d-818e-4390-bd3a-c1d3eb5bbd1f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:01 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 Nov 02 11:51:01 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:02 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328" returned: 0 in 0.400s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:02 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea Nov 02 11:51:02 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:02 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:02 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea Nov 02 11:51:02 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:02 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.86222734-4c10-46f8-9840-a18a046e0eea" returned: 0 in 0.358s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 -F qcow2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:03 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 -F qcow2 Nov 02 11:51:03 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:03 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d636a265-6723-4618-89f8-4822f2d18328 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 -F qcow2" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-86222734-4c10-46f8-9840-a18a046e0eea" released by "_delete_snapshot" :: held 3.661s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" released by "delete_snapshot" :: held 3.698s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Created reservations ['dbfcd107-678e-41fa-90a1-7a7ee617f55b', '18f4b62f-42c9-4999-bfb9-fe56f28e150c', 'c002f654-2e76-44b8-8fd9-a50967ce249e', '1952b64f-9b2b-4a31-be80-eef6e8b83d0b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Delete snapshot completed successfully. Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-86222734-4c10-46f8-9840-a18a046e0eea-delete_snapshot" released by "delete_snapshot" :: held 4.012s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-e1c3ba2e-f341-448b-a10a-9ee0b1b2c853-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-e1c3ba2e-f341-448b-a10a-9ee0b1b2c853-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Deleting offline snapshot e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 of volume d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] snapshot_file for this snap is: volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a32c0e-bced-47b8-a202-130c8c4fff7c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:04 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 Nov 02 11:51:04 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Flow 'volume_create_manager' (f6d4fc46-8f28-45b6-922b-1a4fca410a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf36a5d-d4de-496e-88d9-2fcf1fea897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf36a5d-d4de-496e-88d9-2fcf1fea897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-919930992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b514f5a-cb8c-48ab-b853-467a947c2007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7714fe514d4e04a2157cc96021e276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:04Z,use_quota=True,user_id='9bfe60bbae2d414e8af72b8ad333cad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7fefee-e845-427b-a295-3d891d7211bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7fefee-e845-427b-a295-3d891d7211bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2cdf67-25df-48d2-bce7-241b77f0aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2cdf67-25df-48d2-bce7-241b77f0aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b514f5a-cb8c-48ab-b853-467a947c2007', 'volume_name': 'volume-2b514f5a-cb8c-48ab-b853-467a947c2007', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd37b07a-080c-443d-aa71-bb000268a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd37b07a-080c-443d-aa71-bb000268a35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcb5125-6d77-48fc-8fdc-eb27c867c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Volume 2b514f5a-cb8c-48ab-b853-467a947c2007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b514f5a-cb8c-48ab-b853-467a947c2007', 'volume_size': 1} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-919930992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b514f5a-cb8c-48ab-b853-467a947c2007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7714fe514d4e04a2157cc96021e276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:04Z,use_quota=True,user_id='9bfe60bbae2d414e8af72b8ad333cad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Creating volume 2b514f5a-cb8c-48ab-b853-467a947c2007 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:04 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:04 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" returned: 0 in 0.505s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d636a265-6723-4618-89f8-4822f2d18328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:04 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 1073741824 Nov 02 11:51:04 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090265a-82f3-4d61-af65-b600c34dec4d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:04 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 Nov 02 11:51:04 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:04 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328" returned: 0 in 0.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:04 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 1073741824" returned: 0 in 0.524s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:04 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 Nov 02 11:51:04 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:05 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 Nov 02 11:51:05 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:05 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcb5125-6d77-48fc-8fdc-eb27c867c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b514f5a-cb8c-48ab-b853-467a947c2007', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87826c7c-d3eb-4b77-94bb-36f7e0b0d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Volume volume-2b514f5a-cb8c-48ab-b853-467a947c2007 (2b514f5a-cb8c-48ab-b853-467a947c2007): created successfully Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87826c7c-d3eb-4b77-94bb-36f7e0b0d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Flow 'volume_create_manager' (f6d4fc46-8f28-45b6-922b-1a4fca410a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f4b76a5d-c7a7-4800-a175-648dbae6deb2 tempest-VolumesTransfersV355Test-1786500004 None] Created volume successfully. Nov 02 11:51:05 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" returned: 0 in 0.516s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:05 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853 Nov 02 11:51:05 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:05 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328.e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-e1c3ba2e-f341-448b-a10a-9ee0b1b2c853" released by "_delete_snapshot" :: held 1.907s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" released by "delete_snapshot" :: held 1.953s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Created reservations ['4ad4c562-9bed-4be8-88b7-80baf28703ce', 'aaeee947-24a6-4b62-a42d-b2f22e039fdb', '9a646588-daa8-4f41-ace1-a44d81799fc6', 'de152332-3a0e-43ed-9dc1-0cfc37e3d097'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Delete snapshot completed successfully. Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-e1c3ba2e-f341-448b-a10a-9ee0b1b2c853-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Snapshots deleted, issuing volume delete {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[45199385-0fad-487c-8bd5-36f709dba560]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:06 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 Nov 02 11:51:06 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:06 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:06 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328 Nov 02 11:51:06 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Flow 'volume_create_manager' (6221a461-eb6e-4385-a75f-ad1d1d904fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b779613-aafc-41db-9d69-193d4df3525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d636a265-6723-4618-89f8-4822f2d18328" returned: 0 in 0.312s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b779613-aafc-41db-9d69-193d4df3525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1116536213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb2d864-8d18-4874-b3e6-0cf20d88ded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b112a0ef3b2240b0a2a2254b6c0b53a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:07Z,use_quota=True,user_id='d9ad21e8c9984e3bbc96dbf81fdcc1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e828827-c5f3-4695-baf7-e548d50e31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e828827-c5f3-4695-baf7-e548d50e31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c93b845-9d18-4774-9a03-41b2d8983a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c93b845-9d18-4774-9a03-41b2d8983a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb2d864-8d18-4874-b3e6-0cf20d88ded0', 'volume_name': 'volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1b1e49-b6d1-44c0-98c2-d0b5f5aa2d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1b1e49-b6d1-44c0-98c2-d0b5f5aa2d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba974e5-9c5b-46c3-b87b-85d4cf107a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Volume edb2d864-8d18-4874-b3e6-0cf20d88ded0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0', 'volume_size': 1} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1116536213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb2d864-8d18-4874-b3e6-0cf20d88ded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b112a0ef3b2240b0a2a2254b6c0b53a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:07Z,use_quota=True,user_id='d9ad21e8c9984e3bbc96dbf81fdcc1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Creating volume edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:06 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-d636a265-6723-4618-89f8-4822f2d18328" released by "delete_volume" :: held 0.915s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:06 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 1073741824 Nov 02 11:51:06 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Flow 'volume_create_manager' (f9bc8cb7-3ffe-463b-a641-e547c1dea469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f400df6f-94f0-41a1-8ec6-ff228cc87f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f400df6f-94f0-41a1-8ec6-ff228cc87f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771028752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71786c-e9aa-43aa-8b23-1c044a5b2d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b823f75dae62434caddbdf894ba2b073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:07Z,use_quota=True,user_id='c5fbcbcfbde24c3881ba8f4434288d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2c2d77-4949-4405-9dbe-a88a3d2e30e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2c2d77-4949-4405-9dbe-a88a3d2e30e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92ea069-7be9-4613-9484-c5990f17aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92ea069-7be9-4613-9484-c5990f17aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a71786c-e9aa-43aa-8b23-1c044a5b2d24', 'volume_name': 'volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975f3ca6-6883-4564-b257-6f1e1d655094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975f3ca6-6883-4564-b257-6f1e1d655094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cd6944-480a-46c7-8f18-f622b5d55db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:06 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Volume 3a71786c-e9aa-43aa-8b23-1c044a5b2d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24', 'volume_size': 1} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:06 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Created reservations ['1d21faad-c3c5-4ec4-8916-3398d1c744d6', 'ffb0dd5f-7cfa-4eb6-b20c-facb5bccca65', 'b2b54275-ab92-4871-89cf-1d23d7141a5f', '6201ad1c-106b-46f3-8a09-b674915a6b11'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:07 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:07 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:07 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 1073741824" returned: 0 in 0.510s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=134,cinder:UPDATE=177,cinder:INSERT=48,cinder:DELETE=10 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:51:07 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=178,cinder:SELECT=135,cinder:INSERT=49,cinder:DELETE=20 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Deleted volume successfully. Nov 02 11:51:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-db788336-1539-4d35-bf17-4bbeb6575b9d tempest-VolumesTransfersV355Test-1573632822 None] Transfer volume completed successfully. Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c85528c1-eb1d-47f5-8388-6bfa0636361f tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-d636a265-6723-4618-89f8-4822f2d18328-delete_volume" released by "delete_volume" :: held 7.758s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:07 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 Nov 02 11:51:07 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:07 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771028752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71786c-e9aa-43aa-8b23-1c044a5b2d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b823f75dae62434caddbdf894ba2b073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:07Z,use_quota=True,user_id='c5fbcbcfbde24c3881ba8f4434288d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Creating volume 3a71786c-e9aa-43aa-8b23-1c044a5b2d24 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba974e5-9c5b-46c3-b87b-85d4cf107a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25b9437-be1e-4814-82a4-ff6e1b91fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:07 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 1073741824 Nov 02 11:51:07 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:07 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Volume volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 (edb2d864-8d18-4874-b3e6-0cf20d88ded0): created successfully Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25b9437-be1e-4814-82a4-ff6e1b91fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Flow 'volume_create_manager' (6221a461-eb6e-4385-a75f-ad1d1d904fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9658c947-a83e-4379-93aa-8177fc5078ac tempest-VolumesSnapshotListTestJSON-1950447968 None] Created volume successfully. Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Acquiring lock "cinder-2b514f5a-cb8c-48ab-b853-467a947c2007-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-2b514f5a-cb8c-48ab-b853-467a947c2007-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Acquiring lock "cinder-quobyte-2b514f5a-cb8c-48ab-b853-467a947c2007" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-quobyte-2b514f5a-cb8c-48ab-b853-467a947c2007" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a130c-6fc9-40a3-8e96-f520b2cea2c7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:08 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 Nov 02 11:51:08 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:08 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 1073741824" returned: 0 in 0.561s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:08 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 Nov 02 11:51:08 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Flow 'volume_create_manager' (9805424e-504e-4176-81a1-70e568ba3dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad79df4d-642a-49ee-b2b4-c70b795ebf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad79df4d-642a-49ee-b2b4-c70b795ebf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-290839877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae76cfac-b77c-41f9-b4f9-959c8d811a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7fec07d108417cb26df2e2c35fee93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:08Z,use_quota=True,user_id='520b58237b2b4c768e01baf0fd31fa21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcbedc2-5a76-4f52-ae6d-b6a2d4ef7cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcbedc2-5a76-4f52-ae6d-b6a2d4ef7cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104692fb-f00d-474f-a352-7c2c13b025d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104692fb-f00d-474f-a352-7c2c13b025d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae76cfac-b77c-41f9-b4f9-959c8d811a1e', 'volume_name': 'volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b942054-33d4-45e4-ba25-c2126d579e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b942054-33d4-45e4-ba25-c2126d579e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fda0ed4-5d0d-4dc4-a527-177ef06a7f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Volume ae76cfac-b77c-41f9-b4f9-959c8d811a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e', 'volume_size': 1} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:08 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:08 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007 Nov 02 11:51:08 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:08 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-290839877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae76cfac-b77c-41f9-b4f9-959c8d811a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7fec07d108417cb26df2e2c35fee93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:08Z,use_quota=True,user_id='520b58237b2b4c768e01baf0fd31fa21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Creating volume ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:08 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:08 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e 1073741824 Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cd6944-480a-46c7-8f18-f622b5d55db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:08 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30054a6f-38e9-4c95-a057-a1ebe6fbc8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Volume volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 (3a71786c-e9aa-43aa-8b23-1c044a5b2d24): created successfully Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30054a6f-38e9-4c95-a057-a1ebe6fbc8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Flow 'volume_create_manager' (f9bc8cb7-3ffe-463b-a641-e547c1dea469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-43a781e6-fe1f-4963-9cba-74d91b08c6cc tempest-VolumesTransfersV357Test-1070733028 None] Created volume successfully. Nov 02 11:51:08 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2b514f5a-cb8c-48ab-b853-467a947c2007" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-quobyte-2b514f5a-cb8c-48ab-b853-467a947c2007" released by "delete_volume" :: held 0.738s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:08 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Created reservations ['73d920ed-69dd-48e1-b12b-04a48856c905', '77032a59-dc13-4ee4-b4fd-589680735f01', '87cd69ba-a5f9-4b43-a51b-a61c13b9e969', '0938d3ec-81f0-4b12-a0bc-88a35f7961b6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:09 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:09 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:09 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e 1073741824" returned: 0 in 0.639s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:09 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e Nov 02 11:51:09 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:09 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.441s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Deleted volume successfully. Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-32f44cba-794d-454f-a11b-0622b4ad5d3e tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-2b514f5a-cb8c-48ab-b853-467a947c2007-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:09 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.464s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Creating offline snapshot faedccb6-8da2-415a-8eda-72698ccec3c1 of volume edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fda0ed4-5d0d-4dc4-a527-177ef06a7f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fe647f-c350-4722-98f5-7f09b0402051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[df71faa7-2f59-4ed8-9ac1-f04a02b67056]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Volume volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e (ae76cfac-b77c-41f9-b4f9-959c8d811a1e): created successfully Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fe647f-c350-4722-98f5-7f09b0402051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Flow 'volume_create_manager' (9805424e-504e-4176-81a1-70e568ba3dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9bf28246-9401-41c5-81f0-7af23797bde4 tempest-VolumesTransfersV357Test-516654294 None] Transfer volume completed successfully. Nov 02 11:51:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-17ff7aad-3c36-4e45-8ceb-f18e26dca0c0 tempest-VolumesDeleteCascade-1458560409 None] Created volume successfully. Nov 02 11:51:09 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 Nov 02 11:51:09 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Flow 'volume_create_manager' (fc7813b1-9dc7-4566-8442-6b79ad25488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c3a363-36f6-4f51-80e4-69a4aaa88c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c3a363-36f6-4f51-80e4-69a4aaa88c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-441688387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941cc076-c216-4d7e-a79c-297c200f2e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7714fe514d4e04a2157cc96021e276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:10Z,use_quota=True,user_id='9bfe60bbae2d414e8af72b8ad333cad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93de4b93-bf4f-4315-914f-3ab790d0a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93de4b93-bf4f-4315-914f-3ab790d0a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68fa2ea-4d8b-4961-88e9-b3a7d4cd9ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68fa2ea-4d8b-4961-88e9-b3a7d4cd9ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941cc076-c216-4d7e-a79c-297c200f2e56', 'volume_name': 'volume-941cc076-c216-4d7e-a79c-297c200f2e56', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f74741-85fe-4f88-b668-689e7d0548f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f74741-85fe-4f88-b668-689e7d0548f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273a6810-4e59-47f4-9c1f-b0b3ef21b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:09 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Volume 941cc076-c216-4d7e-a79c-297c200f2e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941cc076-c216-4d7e-a79c-297c200f2e56', 'volume_size': 1} Nov 02 11:51:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:10 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0" returned: 0 in 0.430s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:10 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 1G Nov 02 11:51:10 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Acquiring lock "cinder-3a71786c-e9aa-43aa-8b23-1c044a5b2d24-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-3a71786c-e9aa-43aa-8b23-1c044a5b2d24-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Acquiring lock "cinder-quobyte-3a71786c-e9aa-43aa-8b23-1c044a5b2d24" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-quobyte-3a71786c-e9aa-43aa-8b23-1c044a5b2d24" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3674a93-f24c-478d-aaf0-81532710f950]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:10 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 Nov 02 11:51:10 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:10 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 1G" returned: 0 in 0.443s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:10 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 Nov 02 11:51:10 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:10 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24" returned: 0 in 0.378s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:10 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24 Nov 02 11:51:10 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:10 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:10 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 is being set with open permissions: ugo+rw Nov 02 11:51:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:10 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 Nov 02 11:51:10 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:11 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3a71786c-e9aa-43aa-8b23-1c044a5b2d24" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-quobyte-3a71786c-e9aa-43aa-8b23-1c044a5b2d24" released by "delete_volume" :: held 0.699s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Created reservations ['2e96778c-acfa-4d01-bfcc-f1233535d44c', '5ac686c1-e949-40a7-9b99-4be9568b6577', 'b3f884d0-de27-4d09-b9a6-e8500d62e21d', 'a6ca4e5c-f7eb-4c80-8be7-ff56507bac02'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:11 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:11 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.info Nov 02 11:51:11 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:11 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:11 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:11 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.info" returned: 0 in 0.275s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:11 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.info is being set with open permissions: ugo+rw Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:11 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:11 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.info Nov 02 11:51:11 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.265s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Deleted volume successfully. Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fd2c3e5e-c623-4afe-ba9f-86894470994f tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-3a71786c-e9aa-43aa-8b23-1c044a5b2d24-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:11 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.info" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-441688387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941cc076-c216-4d7e-a79c-297c200f2e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7714fe514d4e04a2157cc96021e276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:10Z,use_quota=True,user_id='9bfe60bbae2d414e8af72b8ad333cad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Creating volume 941cc076-c216-4d7e-a79c-297c200f2e56 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:11 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:11 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 1073741824 Nov 02 11:51:11 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-10890a79-b30c-4cd5-b394-0d94aaae6280 tempest-VolumesSnapshotListTestJSON-1950447968 None] Create snapshot completed successfully Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Flow 'volume_create_manager' (6d037691-f96b-487f-8e9e-1308a60ab171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf83a3e-234b-4754-8113-5fd396c0b5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf83a3e-234b-4754-8113-5fd396c0b5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2101543739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084840a8-12c2-4e49-9746-4a405dcb212c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b823f75dae62434caddbdf894ba2b073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:12Z,use_quota=True,user_id='c5fbcbcfbde24c3881ba8f4434288d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9dc6aa-15c2-48e2-988c-3ca761fa6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9dc6aa-15c2-48e2-988c-3ca761fa6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7feca2-714a-4f20-b2aa-9ac08ad7298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7feca2-714a-4f20-b2aa-9ac08ad7298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084840a8-12c2-4e49-9746-4a405dcb212c', 'volume_name': 'volume-084840a8-12c2-4e49-9746-4a405dcb212c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26769bf8-0dc8-4e9f-b1d6-366002ba4d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26769bf8-0dc8-4e9f-b1d6-366002ba4d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48dfe10-2028-4e79-9c72-722094c8f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Volume 084840a8-12c2-4e49-9746-4a405dcb212c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084840a8-12c2-4e49-9746-4a405dcb212c', 'volume_size': 1} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:12 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 1073741824" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:12 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 Nov 02 11:51:12 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:12 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.483s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Creating offline snapshot 32d0d05e-8984-4d5d-bff7-86847ba55a81 of volume ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273a6810-4e59-47f4-9c1f-b0b3ef21b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941cc076-c216-4d7e-a79c-297c200f2e56', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9684200-ab97-4dfc-aecf-6ffef4fac1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e71403-4ec1-459c-98f1-52e99a3fe292]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Volume volume-941cc076-c216-4d7e-a79c-297c200f2e56 (941cc076-c216-4d7e-a79c-297c200f2e56): created successfully Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9684200-ab97-4dfc-aecf-6ffef4fac1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Flow 'volume_create_manager' (fc7813b1-9dc7-4566-8442-6b79ad25488e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0b0850d3-9fde-46e7-a67c-7d6bc930c661 tempest-VolumesTransfersV355Test-1786500004 None] Created volume successfully. Nov 02 11:51:12 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e Nov 02 11:51:12 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:12 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" returned: 0 in 0.364s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:12 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 1G Nov 02 11:51:12 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Acquiring lock "cinder-941cc076-c216-4d7e-a79c-297c200f2e56-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-941cc076-c216-4d7e-a79c-297c200f2e56-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:13 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Acquiring lock "cinder-quobyte-941cc076-c216-4d7e-a79c-297c200f2e56" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 1G" returned: 0 in 0.483s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-quobyte-941cc076-c216-4d7e-a79c-297c200f2e56" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:13 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 Nov 02 11:51:13 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b46069a-1a12-43e9-a601-7668b2bf0d05]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:13 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 Nov 02 11:51:13 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:13 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81" returned: 0 in 0.299s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:13 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 is being set with open permissions: ugo+rw Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:13 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 Nov 02 11:51:13 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:13 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:13 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56 Nov 02 11:51:13 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:13 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:14 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.info Nov 02 11:51:14 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:14 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-941cc076-c216-4d7e-a79c-297c200f2e56" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-quobyte-941cc076-c216-4d7e-a79c-297c200f2e56" released by "delete_volume" :: held 0.694s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Created reservations ['6a675721-f817-458a-bbf2-8f71e0991712', 'fc7ef063-6221-4a61-b819-f6ee22eeca3c', 'cba1a210-441c-494b-83ed-90b0da22f3a4', '4789f2f8-70a5-4449-9279-03ecfd59682a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:14 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.info" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.info is being set with open permissions: ugo+rw Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:14 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.info Nov 02 11:51:14 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:14 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:14 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:14 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.info" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.455s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2101543739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084840a8-12c2-4e49-9746-4a405dcb212c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b823f75dae62434caddbdf894ba2b073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:12Z,use_quota=True,user_id='c5fbcbcfbde24c3881ba8f4434288d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Creating volume 084840a8-12c2-4e49-9746-4a405dcb212c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:14 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:14 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c 1073741824 Nov 02 11:51:14 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7889807e-f93b-415c-97ba-cddbf0a3cb92 tempest-VolumesDeleteCascade-1458560409 None] Create snapshot completed successfully Nov 02 11:51:14 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.298s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Deleted volume successfully. Nov 02 11:51:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d5820140-e02c-4936-98da-ac9cc00477f4 tempest-VolumesTransfersV355Test-913563656 None] Lock "cinder-941cc076-c216-4d7e-a79c-297c200f2e56-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:15 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c 1073741824" returned: 0 in 0.486s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:15 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c Nov 02 11:51:15 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:15 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.982s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Creating offline snapshot 3bbb0996-f29e-46e9-9664-d8d9c506703f of volume edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48dfe10-2028-4e79-9c72-722094c8f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084840a8-12c2-4e49-9746-4a405dcb212c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2488e68-9bd4-49f2-8afe-fcadbc3e250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[109bcc86-d2a5-483d-8e76-83aa542c1390]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Volume volume-084840a8-12c2-4e49-9746-4a405dcb212c (084840a8-12c2-4e49-9746-4a405dcb212c): created successfully Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2488e68-9bd4-49f2-8afe-fcadbc3e250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Flow 'volume_create_manager' (6d037691-f96b-487f-8e9e-1308a60ab171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-709365bd-01f1-4643-86e4-fa4770214c0a tempest-VolumesTransfersV357Test-1070733028 None] Created volume successfully. Nov 02 11:51:15 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 Nov 02 11:51:15 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Flow 'volume_create_manager' (1b40bc4f-2e03-40d0-8e33-736fa78a3bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d03d074-793f-40ec-8447-527d1e7aab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d03d074-793f-40ec-8447-527d1e7aab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-12051499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec08941-4644-4298-b418-f552dbcaca56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7fec07d108417cb26df2e2c35fee93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32d0d05e-8984-4d5d-bff7-86847ba55a81,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:16Z,use_quota=True,user_id='520b58237b2b4c768e01baf0fd31fa21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:15 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0a3952-89d7-4eb0-a68d-086c226e4062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0a3952-89d7-4eb0-a68d-086c226e4062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43e1ab2-aaab-4a08-a896-f30a47ae2779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43e1ab2-aaab-4a08-a896-f30a47ae2779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eec08941-4644-4298-b418-f552dbcaca56', 'volume_name': 'volume-eec08941-4644-4298-b418-f552dbcaca56', 'volume_size': 1, 'snapshot_id': '32d0d05e-8984-4d5d-bff7-86847ba55a81'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b414618a-1a69-40cc-b244-f438b638a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b414618a-1a69-40cc-b244-f438b638a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6757a25b-7598-43d2-9c45-cc275b474cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Volume eec08941-4644-4298-b418-f552dbcaca56: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eec08941-4644-4298-b418-f552dbcaca56', 'volume_size': 1, 'snapshot_id': '32d0d05e-8984-4d5d-bff7-86847ba55a81'} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1" returned: 0 in 0.493s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:16 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f 1G Nov 02 11:51:16 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:16 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f 1G" returned: 0 in 0.603s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Acquiring lock "cinder-084840a8-12c2-4e49-9746-4a405dcb212c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:16 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f Nov 02 11:51:16 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-084840a8-12c2-4e49-9746-4a405dcb212c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Acquiring lock "cinder-quobyte-084840a8-12c2-4e49-9746-4a405dcb212c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-quobyte-084840a8-12c2-4e49-9746-4a405dcb212c" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d74d3-2e2e-4417-9028-a113f384c628]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:16 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c Nov 02 11:51:16 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:17 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:17 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f is being set with open permissions: ugo+rw Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:17 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f Nov 02 11:51:17 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:17 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c" returned: 0 in 0.414s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:17 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c Nov 02 11:51:17 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:17 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.315s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-32d0d05e-8984-4d5d-bff7-86847ba55a81-eec08941-4644-4298-b418-f552dbcaca56" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-df16282e-1742-4f81-b522-16eeeb7a141e tempest-VolumesSnapshotListTestJSON-1950447968 None] Create snapshot completed successfully Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-32d0d05e-8984-4d5d-bff7-86847ba55a81-eec08941-4644-4298-b418-f552dbcaca56" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Creating volume eec08941-4644-4298-b418-f552dbcaca56 from snapshot 32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-eec08941-4644-4298-b418-f552dbcaca56" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-eec08941-4644-4298-b418-f552dbcaca56" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] snapshot: 32d0d05e-8984-4d5d-bff7-86847ba55a81, volume: eec08941-4644-4298-b418-f552dbcaca56, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[949f56ba-9712-4a57-b1f5-4d9ebc8edd66]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:17 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-084840a8-12c2-4e49-9746-4a405dcb212c" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-quobyte-084840a8-12c2-4e49-9746-4a405dcb212c" released by "delete_volume" :: held 0.770s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Created reservations ['fe4a64c3-ac0f-4e27-ad50-bc910783bb04', '065a93f6-0732-4a14-9516-447342e3681c', '4f96f2b6-5a96-4b18-8113-032edae1bb7d', '9946ab68-5af1-4518-8a9d-63750082d9f0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:17 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 Nov 02 11:51:17 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:17 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:17 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:18 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Deleted volume successfully. Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab27040d-78ef-4be2-8c1f-a6199ade6f1c tempest-VolumesTransfersV357Test-714588936 None] Lock "cinder-084840a8-12c2-4e49-9746-4a405dcb212c-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:18 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81" returned: 0 in 0.625s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81fd48b-f285-4e9c-94ae-a0572b3a432c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:18 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e Nov 02 11:51:18 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:18 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" returned: 0 in 0.441s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:18 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 Nov 02 11:51:18 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:18 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:18 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:19 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:51:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:51:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:51:27 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56" returned: 0 in 8.984s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e, size 1024.00 MB, duration 8.99 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:51:27 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Converted 1024.00 MB image at 113.94 MB/s Nov 02 11:51:27 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 is being set with open permissions: ugo+rw Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:27 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 Nov 02 11:51:27 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:27 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56" returned: 0 in 0.282s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-eec08941-4644-4298-b418-f552dbcaca56" released by "_copy_volume_from_snapshot" :: held 10.434s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-32d0d05e-8984-4d5d-bff7-86847ba55a81-eec08941-4644-4298-b418-f552dbcaca56" released by "_create_volume_from_snapshot" :: held 10.524s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.565s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.937s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Creating offline snapshot 4e46a369-55a3-42a7-8e5a-8db91c660dc7 of volume edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6757a25b-7598-43d2-9c45-cc275b474cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec08941-4644-4298-b418-f552dbcaca56', 'volume_size': 1, 'snapshot_id': '32d0d05e-8984-4d5d-bff7-86847ba55a81'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400e988-53fa-44fb-b843-00b5ae1bd8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43415ae-6371-4016-8521-6459b2f100a6]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Volume volume-eec08941-4644-4298-b418-f552dbcaca56 (eec08941-4644-4298-b418-f552dbcaca56): created successfully Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400e988-53fa-44fb-b843-00b5ae1bd8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Flow 'volume_create_manager' (1b40bc4f-2e03-40d0-8e33-736fa78a3bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:28 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f Nov 02 11:51:28 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-06063508-68f9-41fe-8275-c921a691ab72 tempest-VolumesDeleteCascade-1458560409 None] Created volume successfully. Nov 02 11:51:28 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:28 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 1G Nov 02 11:51:28 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:28 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 1G" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:28 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 Nov 02 11:51:28 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:29 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:29 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 is being set with open permissions: ugo+rw Nov 02 11:51:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:29 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 Nov 02 11:51:29 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:29 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7" returned: 0 in 0.239s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.516s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7fac7a06-1267-4217-b556-e96b203e2f64 tempest-VolumesSnapshotListTestJSON-1950447968 None] Create snapshot completed successfully Nov 02 11:51:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-ae76cfac-b77c-41f9-b4f9-959c8d811a1e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-ae76cfac-b77c-41f9-b4f9-959c8d811a1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-4e46a369-55a3-42a7-8e5a-8db91c660dc7-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Performing cascade delete. {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-32d0d05e-8984-4d5d-bff7-86847ba55a81-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-4e46a369-55a3-42a7-8e5a-8db91c660dc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-32d0d05e-8984-4d5d-bff7-86847ba55a81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-quobyte-4e46a369-55a3-42a7-8e5a-8db91c660dc7" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-4e46a369-55a3-42a7-8e5a-8db91c660dc7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Deleting offline snapshot 4e46a369-55a3-42a7-8e5a-8db91c660dc7 of volume edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] snapshot_file for this snap is: volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-32d0d05e-8984-4d5d-bff7-86847ba55a81" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e4d8dc-aad3-49c5-af58-4d8e9e1f9d2d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-32d0d05e-8984-4d5d-bff7-86847ba55a81" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Deleting offline snapshot 32d0d05e-8984-4d5d-bff7-86847ba55a81 of volume ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] snapshot_file for this snap is: volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6cbb1-8987-4604-9c57-f168c3473eb7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:32 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 Nov 02 11:51:32 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:32 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 Nov 02 11:51:32 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:32 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3962cf4b-709f-42d0-bdf5-23a9b7f587d6]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:32 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81" returned: 0 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f355372-b82d-42f3-a7ff-b64fb7249981]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:32 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f Nov 02 11:51:32 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:33 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e Nov 02 11:51:33 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:33 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:33 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 Nov 02 11:51:33 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:33 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" returned: 0 in 0.532s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:33 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 Nov 02 11:51:33 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:33 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7" returned: 0 in 0.450s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:33 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7 Nov 02 11:51:33 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:33 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:33 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81 Nov 02 11:51:33 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:33 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.4e46a369-55a3-42a7-8e5a-8db91c660dc7" returned: 0 in 0.265s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-4e46a369-55a3-42a7-8e5a-8db91c660dc7" released by "_delete_snapshot" :: held 1.576s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" released by "delete_snapshot" :: held 1.616s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:34 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e.32d0d05e-8984-4d5d-bff7-86847ba55a81" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-32d0d05e-8984-4d5d-bff7-86847ba55a81" released by "_delete_snapshot" :: held 1.627s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" released by "delete_snapshot" :: held 1.666s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Created reservations ['f418d7bc-1c63-4e52-bba2-5c3cf1660e9d', 'ee4e782f-9db1-40f3-ae20-45b53dc4cf68', '9855b475-b07d-4fbd-bbc5-721a211ffa9d', 'db89d5ba-a89a-4c81-a8b9-e508dc591658'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Created reservations ['17129240-5b4f-42e3-8e7c-18ed1a1b90dd', '12f5351c-8b24-4eb7-9c9e-dc237755a030', '19d555c4-9fd3-4a04-be93-20522c020601', 'b1de6140-4e25-4f41-bd97-e038338c04a8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Delete snapshot completed successfully. Nov 02 11:51:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Delete snapshot completed successfully. Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff8b7ff3-9049-4001-88b4-80472f5af083 tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-4e46a369-55a3-42a7-8e5a-8db91c660dc7-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-32d0d05e-8984-4d5d-bff7-86847ba55a81-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Snapshots deleted, issuing volume delete {{(pid=86846) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6902c692-7037-478a-a6dc-ed26f06c82bd]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:34 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e Nov 02 11:51:34 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Flow 'volume_create_manager' (345da7a3-b4a2-4e03-b266-b7c9b7f87506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddbd8f2-06db-4195-be0f-0f808a2721d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddbd8f2-06db-4195-be0f-0f808a2721d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1129942999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f192d3c-5b62-4497-a8f9-abbe99f46a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611a4e30900c415482013bc553148835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:35Z,use_quota=True,user_id='84954bdf2c2b454391ec9b4d5a16822b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47677e80-b125-484c-a089-b422b0ea021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47677e80-b125-484c-a089-b422b0ea021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cb6079-dacd-4922-9c32-50a3ea065204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cb6079-dacd-4922-9c32-50a3ea065204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f192d3c-5b62-4497-a8f9-abbe99f46a1d', 'volume_name': 'volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5141e60f-3f6f-4a71-b5ba-88c05b822d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5141e60f-3f6f-4a71-b5ba-88c05b822d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a975206e-ff58-4e55-8fa8-1727bb2382af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:34 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Volume 3f192d3c-5b62-4497-a8f9-abbe99f46a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d', 'volume_size': 2} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1129942999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f192d3c-5b62-4497-a8f9-abbe99f46a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611a4e30900c415482013bc553148835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:35Z,use_quota=True,user_id='84954bdf2c2b454391ec9b4d5a16822b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Creating volume 3f192d3c-5b62-4497-a8f9-abbe99f46a1d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:34 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d 2147483648 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:34 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d 2147483648 Nov 02 11:51:34 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:35 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:35 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e Nov 02 11:51:35 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:35 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-ae76cfac-b77c-41f9-b4f9-959c8d811a1e" released by "delete_volume" :: held 0.831s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Created reservations ['3d1fbadd-fd45-4df1-b8f2-423ec8965db6', 'bcd6e41a-eee0-4678-82af-e073bc67e874', '3d6358c3-a497-4fa6-8a92-770ea87e88a3', 'ddea3283-ed8a-4b4e-8b3b-b44d24b96e5a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-3bbb0996-f29e-46e9-9664-d8d9c506703f-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-3bbb0996-f29e-46e9-9664-d8d9c506703f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:35 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d 2147483648" returned: 0 in 0.653s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-quobyte-3bbb0996-f29e-46e9-9664-d8d9c506703f" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-3bbb0996-f29e-46e9-9664-d8d9c506703f" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Deleting offline snapshot 3bbb0996-f29e-46e9-9664-d8d9c506703f of volume edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:51:35 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:35 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] snapshot_file for this snap is: volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f32b41-8316-4b8d-a7e7-35646da68e11]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:35 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d Nov 02 11:51:35 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:35 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f Nov 02 11:51:35 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:36 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Deleted volume successfully. Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-eec08941-4644-4298-b418-f552dbcaca56-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:36 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d" returned: 0 in 0.537s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-eec08941-4644-4298-b418-f552dbcaca56-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59decccc-6bb1-4a59-9c72-0c20d7920069 tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-ae76cfac-b77c-41f9-b4f9-959c8d811a1e-delete_volume" released by "delete_volume" :: held 5.940s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a975206e-ff58-4e55-8fa8-1727bb2382af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a26e9-12bd-416f-93b6-48d50d843159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Volume volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d (3f192d3c-5b62-4497-a8f9-abbe99f46a1d): created successfully Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a26e9-12bd-416f-93b6-48d50d843159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Flow 'volume_create_manager' (345da7a3-b4a2-4e03-b266-b7c9b7f87506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "cinder-quobyte-eec08941-4644-4298-b418-f552dbcaca56" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6915a4e3-dd89-46d0-a583-2e8cbb4a59a1 tempest-VolumesCloneNegativeTest-1959003780 None] Created volume successfully. Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-eec08941-4644-4298-b418-f552dbcaca56" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[432cfaa1-edf7-4449-bcf6-56e8b8b74681]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:36 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f" returned: 0 in 0.738s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0071e4ea-40f3-49bc-8106-06741b3051f4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:36 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 Nov 02 11:51:36 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:36 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 Nov 02 11:51:36 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:36 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56" returned: 0 in 0.537s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:37 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56 Nov 02 11:51:37 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:37 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:37 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f Nov 02 11:51:37 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Acquiring lock "cinder-3f192d3c-5b62-4497-a8f9-abbe99f46a1d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "cinder-3f192d3c-5b62-4497-a8f9-abbe99f46a1d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Acquiring lock "cinder-quobyte-3f192d3c-5b62-4497-a8f9-abbe99f46a1d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "cinder-quobyte-3f192d3c-5b62-4497-a8f9-abbe99f46a1d" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:37 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-eec08941-4644-4298-b418-f552dbcaca56" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[58da572f-beba-4fe2-a77c-6a40af07fdf8]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-quobyte-eec08941-4644-4298-b418-f552dbcaca56" released by "delete_volume" :: held 0.973s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Created reservations ['b94dfd51-0abd-4cce-8bb8-20b9d633e7a1', '701ca3fe-62e0-4984-a238-e0cd7308d28d', '7a4a6a00-f415-4901-a7c0-decb3df3cdb4', 'a9ee2ba2-6502-44b8-83b2-bb0ad65071ab'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:37 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d Nov 02 11:51:37 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:37 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:37 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:37 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f" returned: 0 in 0.594s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:37 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f Nov 02 11:51:37 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:37 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.330s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:37 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d" returned: 0 in 0.565s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Deleted volume successfully. Nov 02 11:51:37 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d Nov 02 11:51:37 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-caf68b33-7cbf-4985-a360-33718faaadea tempest-VolumesDeleteCascade-1458560409 None] Lock "cinder-eec08941-4644-4298-b418-f552dbcaca56-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:37 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.3bbb0996-f29e-46e9-9664-d8d9c506703f" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-3bbb0996-f29e-46e9-9664-d8d9c506703f" released by "_delete_snapshot" :: held 2.369s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" released by "delete_snapshot" :: held 2.431s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Created reservations ['4a3e60a9-abce-4689-b037-9627dee89f88', '619f4aed-afbb-424d-b6cd-17eeef37fd3f', '1b0495c9-f924-4250-af27-04d8e69ee585', '35697574-473e-405f-851a-549245b03a4c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Delete snapshot completed successfully. Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6328ecaf-c861-45a6-93cb-98e1b6c96e0d tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-3bbb0996-f29e-46e9-9664-d8d9c506703f-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:38 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3f192d3c-5b62-4497-a8f9-abbe99f46a1d" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "cinder-quobyte-3f192d3c-5b62-4497-a8f9-abbe99f46a1d" released by "delete_volume" :: held 0.963s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Created reservations ['6dadbee6-8b64-4f6e-8a91-9e9f475090a7', 'b91d111d-4f89-44c2-8a91-be8c3cb41a4e', 'bcd9d8e9-70aa-4cca-9b0f-d62f907acdda', '5bc89fb9-06a4-45a1-818a-99d85c1fdc98'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:38 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:38 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:38 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.299s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Deleted volume successfully. Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1016387d-cd84-4590-9562-e457e5524315 tempest-VolumesCloneNegativeTest-1959003780 None] Lock "cinder-3f192d3c-5b62-4497-a8f9-abbe99f46a1d-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-faedccb6-8da2-415a-8eda-72698ccec3c1-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-faedccb6-8da2-415a-8eda-72698ccec3c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-quobyte-faedccb6-8da2-415a-8eda-72698ccec3c1" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-faedccb6-8da2-415a-8eda-72698ccec3c1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Deleting offline snapshot faedccb6-8da2-415a-8eda-72698ccec3c1 of volume edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] snapshot_file for this snap is: volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a328cd2-165d-4e7d-8069-911381d75199]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:39 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 Nov 02 11:51:39 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:39 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1" returned: 0 in 0.463s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[68997ead-60b1-47f5-b141-482c20a4f0ec]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:39 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 Nov 02 11:51:39 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:39 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0" returned: 0 in 0.488s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:39 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 Nov 02 11:51:39 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:40 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:40 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1 Nov 02 11:51:40 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:40 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0.faedccb6-8da2-415a-8eda-72698ccec3c1" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-faedccb6-8da2-415a-8eda-72698ccec3c1" released by "_delete_snapshot" :: held 1.833s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" released by "delete_snapshot" :: held 1.869s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:40 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Created reservations ['a0fa680e-95eb-4ab8-94ed-f19b134650b4', 'a0431c50-b9a6-412a-ac6e-32a61e2c1c76', '87dc5760-7256-43e9-8e00-3588c18f093f', 'cb7592c3-a8fe-4435-ba39-4b83e13e0869'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Delete snapshot completed successfully. Nov 02 11:51:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1c7aab-d5db-4e69-a8fe-c5ab705fd15a tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-faedccb6-8da2-415a-8eda-72698ccec3c1-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-edb2d864-8d18-4874-b3e6-0cf20d88ded0-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-edb2d864-8d18-4874-b3e6-0cf20d88ded0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[637fb11f-2ce6-49dd-b356-2cf0edff2dec]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:41 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 Nov 02 11:51:41 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:41 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0" returned: 0 in 0.494s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:41 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0 Nov 02 11:51:41 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:42 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-edb2d864-8d18-4874-b3e6-0cf20d88ded0" returned: 0 in 0.418s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-quobyte-edb2d864-8d18-4874-b3e6-0cf20d88ded0" released by "delete_volume" :: held 1.023s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Created reservations ['1678bd7b-d2e2-42d6-a8f5-0121d3d16478', '1c07c5cb-591f-4100-8cde-bc9b7b966560', 'a4f677fc-1ba3-4b95-b8cb-f9a707a15ed0', 'f2e35718-f920-4cd9-b868-84c373b8d44f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:42 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:42 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:42 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.331s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Deleted volume successfully. Nov 02 11:51:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3e54375d-8be2-46b8-8d07-61fc0f9f65cb tempest-VolumesSnapshotListTestJSON-1950447968 None] Lock "cinder-edb2d864-8d18-4874-b3e6-0cf20d88ded0-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (4dde0087-a90e-414c-80f2-7cc53d7f6964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27527e4c-7dea-4a39-ac71-88d0d264f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27527e4c-7dea-4a39-ac71-88d0d264f428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-786852006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b480099-663e-4b40-bf92-a88eab0e8c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:44Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf52d6c8-1f01-41d6-b548-7a360e2256c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf52d6c8-1f01-41d6-b548-7a360e2256c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d93cc9e-dffd-4341-8589-b6b6bfea8fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d93cc9e-dffd-4341-8589-b6b6bfea8fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b480099-663e-4b40-bf92-a88eab0e8c03', 'volume_name': 'volume-8b480099-663e-4b40-bf92-a88eab0e8c03', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c533ac3-aa37-48b5-bbcb-61288bc8ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c533ac3-aa37-48b5-bbcb-61288bc8ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ef3868-6ab9-4f0b-b0e2-a2e0f080c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Volume 8b480099-663e-4b40-bf92-a88eab0e8c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b480099-663e-4b40-bf92-a88eab0e8c03', 'volume_size': 1} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-786852006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b480099-663e-4b40-bf92-a88eab0e8c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:44Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Creating volume 8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:44 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 1073741824 Nov 02 11:51:44 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:45 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 1073741824" returned: 0 in 0.593s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:45 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 Nov 02 11:51:45 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Flow 'volume_create_manager' (f6594022-c429-452f-9ed4-4b4c6f95c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:45 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f89e65-d620-4d58-bc90-305e90e716b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f89e65-d620-4d58-bc90-305e90e716b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2062809915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d97f26-209b-4fa6-8eb6-f8c6c23fb868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df7f0198264daca97f5734c4bdaff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:45Z,use_quota=True,user_id='9e97c50bab4e46de96bbdeb5edaac8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f94ac7-087d-4628-b16b-caaa0a31fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f94ac7-087d-4628-b16b-caaa0a31fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae59c047-d3af-405e-aad5-1367067d262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae59c047-d3af-405e-aad5-1367067d262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d97f26-209b-4fa6-8eb6-f8c6c23fb868', 'volume_name': 'volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb4f1dc-4e6b-4349-9373-b271d50541f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb4f1dc-4e6b-4349-9373-b271d50541f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953c686e-aeec-4c97-89cd-85993106d58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Volume 64d97f26-209b-4fa6-8eb6-f8c6c23fb868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868', 'volume_size': 1} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2062809915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d97f26-209b-4fa6-8eb6-f8c6c23fb868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5df7f0198264daca97f5734c4bdaff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:45Z,use_quota=True,user_id='9e97c50bab4e46de96bbdeb5edaac8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Creating volume 64d97f26-209b-4fa6-8eb6-f8c6c23fb868 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:45 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ef3868-6ab9-4f0b-b0e2-a2e0f080c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b480099-663e-4b40-bf92-a88eab0e8c03', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985833be-34f2-493d-8321-ae84d1762fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:45 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 1073741824 Nov 02 11:51:45 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Volume volume-8b480099-663e-4b40-bf92-a88eab0e8c03 (8b480099-663e-4b40-bf92-a88eab0e8c03): created successfully Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985833be-34f2-493d-8321-ae84d1762fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (4dde0087-a90e-414c-80f2-7cc53d7f6964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9d0118e1-a31a-41ae-b2e6-5e7435cf91ee tempest-VolumesSnapshotTestJSON-1580625143 None] Created volume successfully. Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (456a349b-5fc1-42da-bd95-97591f0967d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1171f5a-0606-4870-9a69-f1cb30716cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:46 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 1073741824" returned: 0 in 0.602s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1171f5a-0606-4870-9a69-f1cb30716cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-557043812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1b54a3-81d1-4694-82f2-225c2023d811,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:46Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822545b6-82c7-45cd-8cc4-d025374652b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822545b6-82c7-45cd-8cc4-d025374652b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21390ab-e808-4ccf-8bf9-0e4e03ee3cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21390ab-e808-4ccf-8bf9-0e4e03ee3cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1b54a3-81d1-4694-82f2-225c2023d811', 'volume_name': 'volume-0a1b54a3-81d1-4694-82f2-225c2023d811', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bf0f95-e697-4cd8-bfcd-a5a620c868cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bf0f95-e697-4cd8-bfcd-a5a620c868cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec29359e-35d4-4b40-bcce-14f98b2903cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Volume 0a1b54a3-81d1-4694-82f2-225c2023d811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1b54a3-81d1-4694-82f2-225c2023d811', 'volume_size': 1} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:46 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 Nov 02 11:51:46 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:46 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-557043812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1b54a3-81d1-4694-82f2-225c2023d811,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:46Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Creating volume 0a1b54a3-81d1-4694-82f2-225c2023d811 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:46 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953c686e-aeec-4c97-89cd-85993106d58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:46 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 1073741824 Nov 02 11:51:46 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c7fd4b-208f-414b-b93a-69d69f0dc032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Volume volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 (64d97f26-209b-4fa6-8eb6-f8c6c23fb868): created successfully Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c7fd4b-208f-414b-b93a-69d69f0dc032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Flow 'volume_create_manager' (f6594022-c429-452f-9ed4-4b4c6f95c11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cdd06394-2d2c-4bfc-989e-e166a671d4eb tempest-VolumesMetadataTest-280838247 None] Created volume successfully. Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:47 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 1073741824" returned: 0 in 0.555s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:47 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 Nov 02 11:51:47 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:47 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811" returned: 0 in 0.265s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.309s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec29359e-35d4-4b40-bcce-14f98b2903cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1b54a3-81d1-4694-82f2-225c2023d811', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a244f951-cf5a-447d-a1c2-475a8633203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Creating offline snapshot 0aa77bca-68d3-45f7-96b4-44ddeee690bc of volume 8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:51:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Volume volume-0a1b54a3-81d1-4694-82f2-225c2023d811 (0a1b54a3-81d1-4694-82f2-225c2023d811): created successfully Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a244f951-cf5a-447d-a1c2-475a8633203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (456a349b-5fc1-42da-bd95-97591f0967d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24c1e55-e577-4c10-88f4-e790af74c980]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d90d3df0-c89b-45a2-b31c-67d821597873 tempest-VolumesGetTest-169856308 None] Created volume successfully. Nov 02 11:51:47 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 Nov 02 11:51:47 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:47 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03" returned: 0 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:47 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc 1G Nov 02 11:51:47 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:48 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc 1G" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b480099-663e-4b40-bf92-a88eab0e8c03 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:48 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b480099-663e-4b40-bf92-a88eab0e8c03 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc Nov 02 11:51:48 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Flow 'volume_create_manager' (dbf1b792-5231-4604-a2a5-306b218326fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235bb738-e80a-4535-86d3-da88caefcec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235bb738-e80a-4535-86d3-da88caefcec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1617324266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9217a5a5-60b9-4926-8d67-9add6eab588b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1039dcad85452facebcd383ddfb3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:49Z,use_quota=True,user_id='d414ccc77002424a817e68eeb97fc963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385f8e9d-2372-4070-9665-08987a4b9025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385f8e9d-2372-4070-9665-08987a4b9025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee4376-918b-489c-b5c6-f19648f5e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee4376-918b-489c-b5c6-f19648f5e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9217a5a5-60b9-4926-8d67-9add6eab588b', 'volume_name': 'volume-9217a5a5-60b9-4926-8d67-9add6eab588b', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adefb69e-3bf3-4285-ae53-103db6b2515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adefb69e-3bf3-4285-ae53-103db6b2515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db4e1a4-29f1-4f4b-b5da-081fc3aed905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Volume 9217a5a5-60b9-4926-8d67-9add6eab588b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9217a5a5-60b9-4926-8d67-9add6eab588b', 'volume_size': 2} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:48 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b480099-663e-4b40-bf92-a88eab0e8c03 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc" returned: 0 in 0.389s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:48 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc is being set with open permissions: ugo+rw Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:48 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc Nov 02 11:51:48 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Acquiring lock "cinder-64d97f26-209b-4fa6-8eb6-f8c6c23fb868-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Lock "cinder-64d97f26-209b-4fa6-8eb6-f8c6c23fb868-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Acquiring lock "cinder-quobyte-64d97f26-209b-4fa6-8eb6-f8c6c23fb868" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Lock "cinder-quobyte-64d97f26-209b-4fa6-8eb6-f8c6c23fb868" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[15534e21-e65f-445b-92b2-78b2bbf7c46f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:49 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:49 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 Nov 02 11:51:49 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:49 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.info Nov 02 11:51:49 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (84128da5-da23-40a0-b708-3c9ee1521066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3da172-b045-4f6b-a93a-9f1936ef6c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3da172-b045-4f6b-a93a-9f1936ef6c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-304738943',display_name='tempest-VolumesGetTest-Volume-548477381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e866ac7a-ec5d-4221-892f-8a8ef85ca3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:49Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57065b9-e35f-4e6f-bad2-7ca75c2b395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57065b9-e35f-4e6f-bad2-7ca75c2b395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554a29e6-db9b-4453-aadb-8885ca32a623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554a29e6-db9b-4453-aadb-8885ca32a623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e866ac7a-ec5d-4221-892f-8a8ef85ca3b6', 'volume_name': 'volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60873ec-5e4a-4573-aad5-711bb34b9ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60873ec-5e4a-4573-aad5-711bb34b9ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:49 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8788021-e879-440d-a78b-c077938b6be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Volume e866ac7a-ec5d-4221-892f-8a8ef85ca3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6', 'volume_size': 1} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.info" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:49 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.info is being set with open permissions: ugo+rw Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:49 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868" returned: 0 in 0.450s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:49 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.info Nov 02 11:51:49 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:49 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868 Nov 02 11:51:49 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:49 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.info" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1617324266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9217a5a5-60b9-4926-8d67-9add6eab588b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1039dcad85452facebcd383ddfb3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:49Z,use_quota=True,user_id='d414ccc77002424a817e68eeb97fc963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Creating volume 9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:49 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:49 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b 2147483648 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-64d97f26-209b-4fa6-8eb6-f8c6c23fb868" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:49 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b 2147483648 Nov 02 11:51:49 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Lock "cinder-quobyte-64d97f26-209b-4fa6-8eb6-f8c6c23fb868" released by "delete_volume" :: held 0.776s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2d363bc7-4a2d-4a51-8124-5969c2df87e6 tempest-VolumesSnapshotTestJSON-1580625143 None] Create snapshot completed successfully Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Created reservations ['a3571a8c-7216-4cf5-a058-68919fd78206', 'a3bccaee-8d5d-466a-9628-bc963932d92e', '13cd7eeb-313b-4aa0-94da-e8410989a75b', 'a017686b-e4c4-4c04-8cb2-df8a2dec3ff6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:49 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:49 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:50 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Deleted volume successfully. Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e6268f28-23b2-4e45-a8b2-e6215c13f514 tempest-VolumesMetadataTest-280838247 None] Lock "cinder-64d97f26-209b-4fa6-8eb6-f8c6c23fb868-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:50 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b 2147483648" returned: 0 in 0.533s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:50 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b Nov 02 11:51:50 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-0aa77bca-68d3-45f7-96b4-44ddeee690bc-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-0aa77bca-68d3-45f7-96b4-44ddeee690bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:50 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-304738943',display_name='tempest-VolumesGetTest-Volume-548477381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e866ac7a-ec5d-4221-892f-8a8ef85ca3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:49Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Creating volume e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:50 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-8b480099-663e-4b40-bf92-a88eab0e8c03" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:50 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 1073741824 Nov 02 11:51:50 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db4e1a4-29f1-4f4b-b5da-081fc3aed905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9217a5a5-60b9-4926-8d67-9add6eab588b', 'volume_size': 2}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fff917f-2e8a-417a-a4dc-d15f5ea5a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-8b480099-663e-4b40-bf92-a88eab0e8c03" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-0aa77bca-68d3-45f7-96b4-44ddeee690bc" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-0aa77bca-68d3-45f7-96b4-44ddeee690bc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Deleting offline snapshot 0aa77bca-68d3-45f7-96b4-44ddeee690bc of volume 8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] snapshot_file for this snap is: volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:51:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Volume volume-9217a5a5-60b9-4926-8d67-9add6eab588b (9217a5a5-60b9-4926-8d67-9add6eab588b): created successfully Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fff917f-2e8a-417a-a4dc-d15f5ea5a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Flow 'volume_create_manager' (dbf1b792-5231-4604-a2a5-306b218326fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a9f210-1062-413a-b4e6-c2a347a215d2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-92e9be88-1056-42ba-9cb8-b0a11fb1ee5b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Created volume successfully. Nov 02 11:51:50 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc Nov 02 11:51:50 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:51 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 1073741824" returned: 0 in 0.541s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:51 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b480099-663e-4b40-bf92-a88eab0e8c03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[370ea431-a653-4625-8c90-226b9042af03]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:51 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 Nov 02 11:51:51 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:51 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 Nov 02 11:51:51 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:51 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8788021-e879-440d-a78b-c077938b6be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7691ec00-a924-4e9f-a5d1-ff4bf7834885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Volume volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 (e866ac7a-ec5d-4221-892f-8a8ef85ca3b6): created successfully Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7691ec00-a924-4e9f-a5d1-ff4bf7834885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (84128da5-da23-40a0-b708-3c9ee1521066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-513d3abd-9e61-4339-8cd8-ac2d0811f22c tempest-VolumesGetTest-169856308 None] Created volume successfully. Nov 02 11:51:51 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:51 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc Nov 02 11:51:51 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Creating offline snapshot 51fe6c32-5964-40ce-a359-446aa92b3bdf of volume 9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:51:52 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf65d6a-fcdf-448c-a8b9-3425b83b03c4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc" returned: 0 in 0.433s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:52 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc Nov 02 11:51:52 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:52 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b Nov 02 11:51:52 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:52 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03.0aa77bca-68d3-45f7-96b4-44ddeee690bc" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-0aa77bca-68d3-45f7-96b4-44ddeee690bc" released by "_delete_snapshot" :: held 1.717s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-8b480099-663e-4b40-bf92-a88eab0e8c03" released by "delete_snapshot" :: held 1.750s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['b1b7f34d-65f5-41f8-a965-90c502ec5691', 'd7938f35-aa03-40b0-89b2-f7bff200aff4', '8fc896ca-24fb-472f-8b73-dc3aac45654f', '8a94cabc-7865-4d99-986a-a4b23a03d524'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:52 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b" returned: 0 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf 2G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:52 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf 2G Nov 02 11:51:52 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Delete snapshot completed successfully. Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ff7bd366-706a-4e96-8a18-09c1392531ed tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-0aa77bca-68d3-45f7-96b4-44ddeee690bc-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Lock "cinder-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95afa5f-ac69-4f9c-81cc-bd54db346c8e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:53 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 Nov 02 11:51:53 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:53 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf 2G" returned: 0 in 0.666s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9217a5a5-60b9-4926-8d67-9add6eab588b -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:53 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9217a5a5-60b9-4926-8d67-9add6eab588b -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf Nov 02 11:51:53 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:53 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:53 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6 Nov 02 11:51:53 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (2c919779-1edd-4d15-a49d-268fb181154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950f9950-11cc-499e-8d22-b647e626a48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950f9950-11cc-499e-8d22-b647e626a48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-559087713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d262ace4-e702-4f3e-9b65-e6ebe5400644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:53Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:53 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6857ce0-6e06-422a-9932-705e58bcaa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6857ce0-6e06-422a-9932-705e58bcaa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1df950-268e-400e-8267-2ae9d393e5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1df950-268e-400e-8267-2ae9d393e5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd262ace4-e702-4f3e-9b65-e6ebe5400644', 'volume_name': 'volume-d262ace4-e702-4f3e-9b65-e6ebe5400644', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d632530f-7b87-4c65-9102-3202344bd8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d632530f-7b87-4c65-9102-3202344bd8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390df9a7-151c-4967-a91d-e2cf0a8a16b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Volume d262ace4-e702-4f3e-9b65-e6ebe5400644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d262ace4-e702-4f3e-9b65-e6ebe5400644', 'volume_size': 1} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9217a5a5-60b9-4926-8d67-9add6eab588b -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:53 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf is being set with open permissions: ugo+rw Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:53 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf Nov 02 11:51:53 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:53 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6" released by "delete_volume" :: held 0.910s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Created reservations ['74683916-07cc-435a-8db8-05add60cbd00', '2dcbc49a-ada9-4f0d-8c4a-4f6443d031df', '9b5a3cc0-8a7e-452b-b0e1-6a8b348943d2', 'be30ed22-2b87-4730-9813-39325ac2789f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:53 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:53 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:53 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:53 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.info Nov 02 11:51:53 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:54 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.283s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Deleted volume successfully. Nov 02 11:51:54 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-87f6469d-ea54-46f5-bc2d-c23a0c235b9f tempest-VolumesGetTest-169856308 None] Lock "cinder-e866ac7a-ec5d-4221-892f-8a8ef85ca3b6-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.info" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:54 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.info is being set with open permissions: ugo+rw Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:54 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.info Nov 02 11:51:54 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:54 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.info" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-559087713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d262ace4-e702-4f3e-9b65-e6ebe5400644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:53Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Creating volume d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:54 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:54 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 1073741824 Nov 02 11:51:54 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c71cb9f0-66fc-42e8-ae85-8fb6824f1700 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Create snapshot completed successfully Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Flow 'volume_create_manager' (0ec60760-6f32-4245-846f-c9b49a2e163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d33ef2-8f6f-4067-a9a1-c79f14ec269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d33ef2-8f6f-4067-a9a1-c79f14ec269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-52082509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1809d5e1-379d-46e5-bd3e-7ab6892dca58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b74f479715c43538644ee94ca174f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:55Z,use_quota=True,user_id='fdab3d43ea77422bb417034634323f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd5e55-1696-4856-944a-755e42151b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd5e55-1696-4856-944a-755e42151b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d24e5d-4c23-41ac-82ab-3cc7d4eb7430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d24e5d-4c23-41ac-82ab-3cc7d4eb7430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1809d5e1-379d-46e5-bd3e-7ab6892dca58', 'volume_name': 'volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06ef73-f11e-4595-b5cf-835b594427e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06ef73-f11e-4595-b5cf-835b594427e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3110bbe-1601-453e-9385-df3024d244a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Volume 1809d5e1-379d-46e5-bd3e-7ab6892dca58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58', 'volume_size': 1} Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:54 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 1073741824" returned: 0 in 0.449s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-0a1b54a3-81d1-4694-82f2-225c2023d811-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:55 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 Nov 02 11:51:55 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Lock "cinder-0a1b54a3-81d1-4694-82f2-225c2023d811-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-0a1b54a3-81d1-4694-82f2-225c2023d811" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-0a1b54a3-81d1-4694-82f2-225c2023d811" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d112f3-beac-4fe2-919d-d111e1b11ac8]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "cinder-51fe6c32-5964-40ce-a359-446aa92b3bdf-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-51fe6c32-5964-40ce-a359-446aa92b3bdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "cinder-quobyte-9217a5a5-60b9-4926-8d67-9add6eab588b" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:55 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 Nov 02 11:51:55 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-quobyte-9217a5a5-60b9-4926-8d67-9add6eab588b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "cinder-quobyte-51fe6c32-5964-40ce-a359-446aa92b3bdf" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:55 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-quobyte-51fe6c32-5964-40ce-a359-446aa92b3bdf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Deleting offline snapshot 51fe6c32-5964-40ce-a359-446aa92b3bdf of volume 9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] snapshot_file for this snap is: volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-52082509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1809d5e1-379d-46e5-bd3e-7ab6892dca58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b74f479715c43538644ee94ca174f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:55Z,use_quota=True,user_id='fdab3d43ea77422bb417034634323f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Creating volume 1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:55 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9a7683-168a-4c49-8a9e-c1649cecaac3]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:55 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 1073741824 Nov 02 11:51:55 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390df9a7-151c-4967-a91d-e2cf0a8a16b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d262ace4-e702-4f3e-9b65-e6ebe5400644', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88938fd5-d805-417b-b40a-2397844aa4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Volume volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 (d262ace4-e702-4f3e-9b65-e6ebe5400644): created successfully Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88938fd5-d805-417b-b40a-2397844aa4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (2c919779-1edd-4d15-a49d-268fb181154b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-350e60c9-1955-4014-86c0-e1cadb11ddf1 tempest-VolumesSnapshotTestJSON-1580625143 None] Created volume successfully. Nov 02 11:51:55 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf Nov 02 11:51:55 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:55 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:55 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811 Nov 02 11:51:55 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:55 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9217a5a5-60b9-4926-8d67-9add6eab588b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af9f6c6-8811-4b73-b823-e9fbea7dded1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:55 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 1073741824" returned: 0 in 0.504s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:55 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0a1b54a3-81d1-4694-82f2-225c2023d811" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-0a1b54a3-81d1-4694-82f2-225c2023d811" released by "delete_volume" :: held 0.818s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:55 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 Nov 02 11:51:55 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:55 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b Nov 02 11:51:55 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Created reservations ['ae9b4711-3771-40eb-b810-3938dba56a8d', '0b5a989e-b5a9-4c65-bb6f-9a9586adac8b', 'bd95e68d-3642-4314-972f-4127520f45cf', '3df5b204-dbb1-4638-a608-e89bd621788f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:56 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:56 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:56 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58" returned: 0 in 0.289s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3110bbe-1601-453e-9385-df3024d244a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614e3378-c714-4427-abeb-6184af5e392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Volume volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 (1809d5e1-379d-46e5-bd3e-7ab6892dca58): created successfully Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614e3378-c714-4427-abeb-6184af5e392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Flow 'volume_create_manager' (0ec60760-6f32-4245-846f-c9b49a2e163a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:56 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b" returned: 0 in 0.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-585292a8-3e7a-4ada-a7de-f470b0942423 tempest-VolumesCloneTest-1853858914 None] Created volume successfully. Nov 02 11:51:56 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf Nov 02 11:51:56 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:56 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Deleted volume successfully. Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be3262c7-8258-4ce3-97b6-165cdb6a07cf tempest-VolumesGetTest-169856308 None] Lock "cinder-0a1b54a3-81d1-4694-82f2-225c2023d811-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:56 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf" returned: 0 in 0.470s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:56 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf Nov 02 11:51:56 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (a4e5b59c-fc43-4808-ba52-6b7aa845dcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b742d4-c6df-4882-9aed-bb6dc487668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Creating offline snapshot 47304b0c-adf8-42b5-8fc5-b6fab17e196a of volume d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b742d4-c6df-4882-9aed-bb6dc487668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1318407548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3cc943-3c83-497d-8ca2-61bb30d89201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:57Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6689f7b-0224-4f0a-ae67-3bd37cc9be3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6689f7b-0224-4f0a-ae67-3bd37cc9be3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71264711-df93-480e-893e-9ac294d3d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71264711-df93-480e-893e-9ac294d3d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3cc943-3c83-497d-8ca2-61bb30d89201', 'volume_name': 'volume-9c3cc943-3c83-497d-8ca2-61bb30d89201', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c67bddf-0256-41e6-9600-15ee6d80db34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c67bddf-0256-41e6-9600-15ee6d80db34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4469377-f96b-4d88-a385-44d2f0e9cebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Volume 9c3cc943-3c83-497d-8ca2-61bb30d89201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3cc943-3c83-497d-8ca2-61bb30d89201', 'volume_size': 1} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a97fad-36f2-4550-bab7-2d2d5610e3ce]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:57 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b.51fe6c32-5964-40ce-a359-446aa92b3bdf" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:57 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 Nov 02 11:51:57 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-quobyte-51fe6c32-5964-40ce-a359-446aa92b3bdf" released by "_delete_snapshot" :: held 1.781s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-quobyte-9217a5a5-60b9-4926-8d67-9add6eab588b" released by "delete_snapshot" :: held 1.811s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Created reservations ['0533c457-e7a5-4dc1-b6b8-c87d913ee4bf', '7cedcb4b-08f3-4b19-b9dd-227d861d080b', 'a394e8ba-5a88-4d84-af3d-fbf250bae2c0', '5af97e41-7942-447e-a053-b1e4ccb18806'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Delete snapshot completed successfully. Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-748ab90f-4a38-4cb4-b508-effd91562b40 tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-51fe6c32-5964-40ce-a359-446aa92b3bdf-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Flow 'volume_create_manager' (45485a02-150e-4898-935d-c05d6713551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e064130-38ce-4588-a821-3c783d8d7aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e064130-38ce-4588-a821-3c783d8d7aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1374743975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3592618d-257e-45c7-b192-2ef441639437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b74f479715c43538644ee94ca174f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1809d5e1-379d-46e5-bd3e-7ab6892dca58,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:57Z,use_quota=True,user_id='fdab3d43ea77422bb417034634323f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eb996d-f2df-499b-a6b6-79ba5063aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eb996d-f2df-499b-a6b6-79ba5063aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:57 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d591faa-d105-47ae-8809-e880fabd66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644" returned: 0 in 0.481s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d591faa-d105-47ae-8809-e880fabd66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3592618d-257e-45c7-b192-2ef441639437', 'volume_name': 'volume-3592618d-257e-45c7-b192-2ef441639437', 'volume_size': 2, 'source_volid': '1809d5e1-379d-46e5-bd3e-7ab6892dca58', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:57 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a 1G Nov 02 11:51:57 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9dc52a-b377-4eb3-96d9-79674f04e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9dc52a-b377-4eb3-96d9-79674f04e29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b8597e-ba5f-43c7-be45-e58fae07a6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:51:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Volume 3592618d-257e-45c7-b192-2ef441639437: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3592618d-257e-45c7-b192-2ef441639437', 'volume_size': 2, 'source_volid': '1809d5e1-379d-46e5-bd3e-7ab6892dca58', 'source_volstatus': 'available'} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "cinder-9217a5a5-60b9-4926-8d67-9add6eab588b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-9217a5a5-60b9-4926-8d67-9add6eab588b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "cinder-quobyte-9217a5a5-60b9-4926-8d67-9add6eab588b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-quobyte-9217a5a5-60b9-4926-8d67-9add6eab588b" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58409c0-b3cf-47e3-b20d-9cfbc27cfbcf]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:57 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b Nov 02 11:51:57 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:57 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a 1G" returned: 0 in 0.474s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:57 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a Nov 02 11:51:57 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:58 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:58 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b Nov 02 11:51:58 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:58 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a is being set with open permissions: ugo+rw Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:58 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a Nov 02 11:51:58 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:58 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9217a5a5-60b9-4926-8d67-9add6eab588b" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-quobyte-9217a5a5-60b9-4926-8d67-9add6eab588b" released by "delete_volume" :: held 0.767s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Created reservations ['f616a5dc-5176-40ef-a04d-9f38b148017e', 'cfc81ee6-d53e-4e06-98c1-edb2cc6b57fe', 'f35bdd79-074a-4e92-b4cb-e2a68254c137', '8ee3a714-d35a-442e-9c93-b72e31c952f2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:51:58 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:58 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:51:58 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:58 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.info Nov 02 11:51:58 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:58 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:51:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Deleted volume successfully. Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b60a1aaf-b555-4e9d-8619-6906cbc5b70b tempest-VolumesSnapshotNegativeTestJSON-1441687467 None] Lock "cinder-9217a5a5-60b9-4926-8d67-9add6eab588b-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:51:58 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.info" returned: 0 in 0.310s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.info is being set with open permissions: ugo+rw Nov 02 11:51:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:58 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.info Nov 02 11:51:58 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:59 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.info" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.227s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1318407548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3cc943-3c83-497d-8ca2-61bb30d89201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:51:57Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Creating volume 9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:51:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:59 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 1073741824 Nov 02 11:51:59 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:51:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5df50174-e37b-434a-bff9-e77fce2baca8 tempest-VolumesSnapshotTestJSON-1580625143 None] Create snapshot completed successfully Nov 02 11:51:59 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 1073741824" returned: 0 in 0.499s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:51:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:51:59 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 Nov 02 11:51:59 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:00 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.529s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:00 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Cloning volume 1809d5e1-379d-46e5-bd3e-7ab6892dca58 to volume 3592618d-257e-45c7-b192-2ef441639437 Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4469377-f96b-4d88-a385-44d2f0e9cebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3cc943-3c83-497d-8ca2-61bb30d89201', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91f5662-6659-45f0-af59-fb529b6d7114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Volume volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 (9c3cc943-3c83-497d-8ca2-61bb30d89201): created successfully Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91f5662-6659-45f0-af59-fb529b6d7114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (a4e5b59c-fc43-4808-ba52-6b7aa845dcea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Creating offline snapshot 22899408-08bd-4481-be39-00586f496924 of volume 1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:52:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-645d14f8-15a7-4c83-b7de-3ef2100cb1a5 tempest-VolumesGetTest-169856308 None] Created volume successfully. Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45cb023-ebc4-4b80-970b-3b7f2bd89a06]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:00 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 Nov 02 11:52:00 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (e396638a-8e28-4a08-bd38-b95fad1106a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3974d21c-bf95-4f8e-9f0e-1d85a606cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3974d21c-bf95-4f8e-9f0e-1d85a606cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-23012352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468318eb-4b20-42c7-9963-c4150036a5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=47304b0c-adf8-42b5-8fc5-b6fab17e196a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:01Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3da120e-161c-4307-be9a-ea03ca95be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3da120e-161c-4307-be9a-ea03ca95be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddb7ec1-cd80-433e-b270-e7055f4f7f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddb7ec1-cd80-433e-b270-e7055f4f7f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '468318eb-4b20-42c7-9963-c4150036a5b7', 'volume_name': 'volume-468318eb-4b20-42c7-9963-c4150036a5b7', 'volume_size': 2, 'snapshot_id': '47304b0c-adf8-42b5-8fc5-b6fab17e196a'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:00 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c78aa30-9ece-4bcf-b633-e0a33a2f61ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c78aa30-9ece-4bcf-b633-e0a33a2f61ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b478e1-189c-4016-9200-caf667fd2de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Volume 468318eb-4b20-42c7-9963-c4150036a5b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-468318eb-4b20-42c7-9963-c4150036a5b7', 'volume_size': 2, 'snapshot_id': '47304b0c-adf8-42b5-8fc5-b6fab17e196a'} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58" returned: 0 in 0.528s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:00 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 1G Nov 02 11:52:00 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:01 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 1G" returned: 0 in 0.471s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:01 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 Nov 02 11:52:01 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:01 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924" returned: 0 in 0.410s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:01 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 is being set with open permissions: ugo+rw Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:01 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 Nov 02 11:52:01 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (36982707-9771-41ec-a6f4-92eb172bda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defcca86-79fe-4568-aad8-a6307adf3ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defcca86-79fe-4568-aad8-a6307adf3ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1289897063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530fa586-bf07-455f-afce-a89a8558385e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9c3cc943-3c83-497d-8ca2-61bb30d89201,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:02Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f324c2-b211-4a7d-a69e-fc5ca86359f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f324c2-b211-4a7d-a69e-fc5ca86359f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb2c838-12b2-4da2-b858-6bb93531f911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb2c838-12b2-4da2-b858-6bb93531f911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '530fa586-bf07-455f-afce-a89a8558385e', 'volume_name': 'volume-530fa586-bf07-455f-afce-a89a8558385e', 'volume_size': 1, 'source_volid': '9c3cc943-3c83-497d-8ca2-61bb30d89201', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54feca25-9a76-449b-83e5-abd0ea237cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54feca25-9a76-449b-83e5-abd0ea237cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a32d9e6-4d4b-4174-b7ab-fd1f0a323992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Volume 530fa586-bf07-455f-afce-a89a8558385e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-530fa586-bf07-455f-afce-a89a8558385e', 'volume_size': 1, 'source_volid': '9c3cc943-3c83-497d-8ca2-61bb30d89201', 'source_volstatus': 'available'} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:01 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:01 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.info Nov 02 11:52:01 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:02 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.info" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:02 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.info is being set with open permissions: ugo+rw Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:02 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.info Nov 02 11:52:02 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:02 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.info" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "cinder-quobyte-3592618d-257e-45c7-b192-2ef441639437" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-3592618d-257e-45c7-b192-2ef441639437" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] snapshot: 22899408-08bd-4481-be39-00586f496924, volume: 3592618d-257e-45c7-b192-2ef441639437, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a82ce84-a378-457c-b652-b72441ba4ed8]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:02 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 Nov 02 11:52:02 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:02 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924" returned: 0 in 0.395s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eefe456-4401-413f-8e02-2e3c5bf1608d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:03 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 Nov 02 11:52:03 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:03 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:52:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:52:03 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:52:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:03 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 Nov 02 11:52:03 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=151,cinder:INSERT=52,cinder:DELETE=17,cinder:UPDATE=197 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=173,cinder:SELECT=164,cinder:INSERT=42,cinder:DELETE=18 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Flow 'volume_create_manager' (1065cb80-4ad4-41a7-a4ef-3329bcd0129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275bfd77-4308-4340-b4a6-3774c819cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275bfd77-4308-4340-b4a6-3774c819cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ab9fc3-ad54-40b2-85c5-3e32d02d8f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723c16998ab54c24918de695da40182d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:08Z,use_quota=True,user_id='80851bfb0a8d43ce9eaebaffdece3f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7d6c066-9508-4d5c-852e-29510cfbb6e8),volume_type_id=c7d6c066-9508-4d5c-852e-29510cfbb6e8)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796fc330-d899-44de-bcd3-bab19358df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796fc330-d899-44de-bcd3-bab19358df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60e400b-2430-4bb5-9d88-7ae9108be84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:07 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60e400b-2430-4bb5-9d88-7ae9108be84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17ab9fc3-ad54-40b2-85c5-3e32d02d8f50', 'volume_name': 'volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50', 'volume_size': 1, 'image_id': '578a0c92-4da9-4e30-976a-35b5073d4f09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/578a0c92-4da9-4e30-976a-35b5073d4f09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4f2b9ed8ab5b085b47fc52c17480d38', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '723c16998ab54c24918de695da40182d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e594f79310a7a4e13ad0f9943e62333751857f3fd5a939ee0247db4b49c25c6e6c02f6b441a56a8e16b506e9fda060f8e5ae0625421fc904d71f58799f5f51e4', 'id': '578a0c92-4da9-4e30-976a-35b5073d4f09', 'created_at': datetime.datetime(2026, 11, 2, 10, 52, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 52, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/578a0c92-4da9-4e30-976a-35b5073d4f09/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abeda5e0-fcea-49e0-b466-ee66ce9f017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abeda5e0-fcea-49e0-b466-ee66ce9f017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f3596a-1008-4bd5-b2ee-c00346b92aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:08 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Volume 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50', 'volume_size': 1, 'image_id': '578a0c92-4da9-4e30-976a-35b5073d4f09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/578a0c92-4da9-4e30-976a-35b5073d4f09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4f2b9ed8ab5b085b47fc52c17480d38', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '723c16998ab54c24918de695da40182d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e594f79310a7a4e13ad0f9943e62333751857f3fd5a939ee0247db4b49c25c6e6c02f6b441a56a8e16b506e9fda060f8e5ae0625421fc904d71f58799f5f51e4', 'id': '578a0c92-4da9-4e30-976a-35b5073d4f09', 'created_at': datetime.datetime(2026, 11, 2, 10, 52, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 52, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/578a0c92-4da9-4e30-976a-35b5073d4f09/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Trying to clone 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 from image 578a0c92-4da9-4e30-976a-35b5073d4f09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/578a0c92-4da9-4e30-976a-35b5073d4f09', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:52:08 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Image download 0.00 MB at 0.00 MB/s Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d838d301-bb4c-486d-98ef-fbbd7e280f79]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:09 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD Nov 02 11:52:09 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:09 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:09 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD Nov 02 11:52:09 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:10 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD" returned: 1 in 0.669s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Temporary image 578a0c92-4da9-4e30-976a-35b5073d4f09 is fetched for user 80851bfb0a8d43ce9eaebaffdece3f50. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a52c99d-9b8e-43cf-9f67-02ab775579fc]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:10 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD Nov 02 11:52:10 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:10 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437" returned: 0 in 7.173s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:52:10 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Converted 1024.00 MB image at 142.70 MB/s Nov 02 11:52:10 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 is being set with open permissions: ugo+rw Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:10 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 Nov 02 11:52:10 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:10 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:10 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-3592618d-257e-45c7-b192-2ef441639437" released by "_copy_volume_from_snapshot" :: held 8.299s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "cinder-quobyte-22899408-08bd-4481-be39-00586f496924" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:10 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD Nov 02 11:52:10 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-22899408-08bd-4481-be39-00586f496924" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Deleting offline snapshot 22899408-08bd-4481-be39-00586f496924 of volume 1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] snapshot_file for this snap is: volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb2f23e-6ea8-4f78-beb3-2d24f736df02]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:10 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 Nov 02 11:52:10 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:11 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:11 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6ea175-032f-474f-b81f-4fe037ce871a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:11 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 Nov 02 11:52:11 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:11 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58" returned: 0 in 0.539s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:11 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 Nov 02 11:52:11 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:12 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:12 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924 Nov 02 11:52:12 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:12 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58.22899408-08bd-4481-be39-00586f496924" returned: 0 in 0.229s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-22899408-08bd-4481-be39-00586f496924" released by "_delete_snapshot" :: held 1.550s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.367s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.710s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-47304b0c-adf8-42b5-8fc5-b6fab17e196a-468318eb-4b20-42c7-9963-c4150036a5b7" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b8597e-ba5f-43c7-be45-e58fae07a6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3592618d-257e-45c7-b192-2ef441639437', 'volume_size': 2, 'source_volid': '1809d5e1-379d-46e5-bd3e-7ab6892dca58', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8037668-a313-4468-a8c5-3a85476e3dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-47304b0c-adf8-42b5-8fc5-b6fab17e196a-468318eb-4b20-42c7-9963-c4150036a5b7" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Creating volume 468318eb-4b20-42c7-9963-c4150036a5b7 from snapshot 47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-468318eb-4b20-42c7-9963-c4150036a5b7" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Volume volume-3592618d-257e-45c7-b192-2ef441639437 (3592618d-257e-45c7-b192-2ef441639437): created successfully Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8037668-a313-4468-a8c5-3a85476e3dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Flow 'volume_create_manager' (45485a02-150e-4898-935d-c05d6713551d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-468318eb-4b20-42c7-9963-c4150036a5b7" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] snapshot: 47304b0c-adf8-42b5-8fc5-b6fab17e196a, volume: 468318eb-4b20-42c7-9963-c4150036a5b7, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6971d46e-af4b-4c88-891f-32c51706f904 tempest-VolumesCloneTest-1853858914 None] Created volume successfully. Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f99c3c0-efd9-4882-a3e4-663ca3bade9a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:12 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a Nov 02 11:52:12 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "cinder-3592618d-257e-45c7-b192-2ef441639437-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:12 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d262ace4-e702-4f3e-9b65-e6ebe5400644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-3592618d-257e-45c7-b192-2ef441639437-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a96be98-2576-4945-8213-6f31730fd81d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "cinder-quobyte-3592618d-257e-45c7-b192-2ef441639437" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-3592618d-257e-45c7-b192-2ef441639437" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd7496-af32-4255-9100-d2a362a43189]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:13 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 Nov 02 11:52:13 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:13 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 Nov 02 11:52:13 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:13 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644" returned: 0 in 0.371s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:13 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 Nov 02 11:52:13 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:13 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:13 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437 Nov 02 11:52:13 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:13 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3592618d-257e-45c7-b192-2ef441639437" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-3592618d-257e-45c7-b192-2ef441639437" released by "delete_volume" :: held 0.724s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Created reservations ['4d6635ed-9b80-45ee-bb00-a7232f0fbe8c', 'a96f2fae-aa28-4f2a-b37e-38cca2333bf6', '135102d0-445b-49ca-8bc6-66d42401be3c', '433782da-22a3-4813-9ed8-65a89c32700d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:13 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:13 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "cinder-1809d5e1-379d-46e5-bd3e-7ab6892dca58-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-1809d5e1-379d-46e5-bd3e-7ab6892dca58-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:14 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Deleted volume successfully. Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "cinder-quobyte-1809d5e1-379d-46e5-bd3e-7ab6892dca58" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5452fc51-119e-422d-8888-ccf9e9479450 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-3592618d-257e-45c7-b192-2ef441639437-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-1809d5e1-379d-46e5-bd3e-7ab6892dca58" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8272a7-006e-49a7-bf18-a179d6bc7cf5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:14 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 Nov 02 11:52:14 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:15 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58" returned: 0 in 0.573s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:15 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58 Nov 02 11:52:15 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:15 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1809d5e1-379d-46e5-bd3e-7ab6892dca58" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-quobyte-1809d5e1-379d-46e5-bd3e-7ab6892dca58" released by "delete_volume" :: held 1.168s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Created reservations ['51550965-d6ff-468e-bc16-67747296684e', '9fad2bbb-b93d-4189-81a7-ba46cb13e053', '09ad7c52-c8de-44da-a565-6a84d7ed7d6d', 'a2e43727-996f-441f-bbd6-7980900cbe01'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:15 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:15 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:16 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:16 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Deleted volume successfully. Nov 02 11:52:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1065c440-3b87-46f8-9bda-8549654ad8c7 tempest-VolumesCloneTest-1853858914 None] Lock "cinder-1809d5e1-379d-46e5-bd3e-7ab6892dca58-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:52:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:18 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:19 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:19 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:52:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:52:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:52:20 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7" returned: 0 in 7.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:52:20 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Converted 1024.00 MB image at 139.45 MB/s Nov 02 11:52:20 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 is being set with open permissions: ugo+rw Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:20 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 Nov 02 11:52:20 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:20 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-468318eb-4b20-42c7-9963-c4150036a5b7" released by "_copy_volume_from_snapshot" :: held 8.452s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-47304b0c-adf8-42b5-8fc5-b6fab17e196a-468318eb-4b20-42c7-9963-c4150036a5b7" released by "_create_volume_from_snapshot" :: held 8.531s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.564s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 19.240s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:20 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Cloning volume 9c3cc943-3c83-497d-8ca2-61bb30d89201 to volume 530fa586-bf07-455f-afce-a89a8558385e Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b478e1-189c-4016-9200-caf667fd2de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468318eb-4b20-42c7-9963-c4150036a5b7', 'volume_size': 2, 'snapshot_id': '47304b0c-adf8-42b5-8fc5-b6fab17e196a'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0542b05e-a38a-4c20-aa27-64687a369bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Creating offline snapshot a7fc9d66-b631-4050-bd7b-bf165fe16de8 of volume 9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:52:21 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Volume volume-468318eb-4b20-42c7-9963-c4150036a5b7 (468318eb-4b20-42c7-9963-c4150036a5b7): created successfully Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0542b05e-a38a-4c20-aa27-64687a369bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (e396638a-8e28-4a08-bd38-b95fad1106a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[201894ea-9074-4e33-bb97-c7aeaab14e77]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3586a99a-23f7-4358-a55f-cbcd4128e02d tempest-VolumesSnapshotTestJSON-1580625143 None] Created volume successfully. Nov 02 11:52:21 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 Nov 02 11:52:21 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:21 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201" returned: 0 in 0.389s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:21 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 1G Nov 02 11:52:21 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-468318eb-4b20-42c7-9963-c4150036a5b7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-468318eb-4b20-42c7-9963-c4150036a5b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-468318eb-4b20-42c7-9963-c4150036a5b7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-468318eb-4b20-42c7-9963-c4150036a5b7" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b678eb9b-ac40-46b9-bd67-76d630255cef]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:21 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 Nov 02 11:52:21 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:21 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 1G" returned: 0 in 0.479s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:21 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 Nov 02 11:52:21 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:22 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7" returned: 0 in 0.411s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:22 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7 Nov 02 11:52:22 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:22 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8" returned: 0 in 0.316s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:22 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 is being set with open permissions: ugo+rw Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:22 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 Nov 02 11:52:22 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:22 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-468318eb-4b20-42c7-9963-c4150036a5b7" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-468318eb-4b20-42c7-9963-c4150036a5b7" released by "delete_volume" :: held 0.761s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['a0f2b225-060a-4c75-8327-9042f7da9094', 'bcd7d9f9-0e23-4eb2-bb79-5f6801c07d9f', '346edc64-52f0-4c56-96ff-a8edc4241654', '6bdadc85-6ba9-4aa5-a679-94d535863d9a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:22 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8" returned: 0 in 0.316s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:22 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.info Nov 02 11:52:22 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:22 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:22 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Flow 'volume_create_manager' (6219abdb-cf4a-4c25-88b3-f0525d1a8c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afc72f4-e93c-410d-8b4c-54e558b30740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afc72f4-e93c-410d-8b4c-54e558b30740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-369849095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e900dcb5-a507-4be9-9778-9da7dafb9409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c230c50aac1346959137ae541d1af2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:23Z,use_quota=True,user_id='88bd4024435d471fa2b37b3b41b2c04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7e3662-f367-41f9-b3f7-90ba11210606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7e3662-f367-41f9-b3f7-90ba11210606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517c67f7-8e87-4721-a35e-d58afbcfa9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:52:22 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-47304b0c-adf8-42b5-8fc5-b6fab17e196a-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.info" returned: 0 in 0.280s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:22 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.info is being set with open permissions: ugo+rw Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:22 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.info Nov 02 11:52:22 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-47304b0c-adf8-42b5-8fc5-b6fab17e196a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-d262ace4-e702-4f3e-9b65-e6ebe5400644" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-d262ace4-e702-4f3e-9b65-e6ebe5400644" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-47304b0c-adf8-42b5-8fc5-b6fab17e196a" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-47304b0c-adf8-42b5-8fc5-b6fab17e196a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Deleting offline snapshot 47304b0c-adf8-42b5-8fc5-b6fab17e196a of volume d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] snapshot_file for this snap is: volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa52541-0ecc-4123-a960-e9eff698f112]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:22 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Deleted volume successfully. Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ab207c8e-767c-4339-ab28-bd409044b0b4 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-468318eb-4b20-42c7-9963-c4150036a5b7-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:23 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a Nov 02 11:52:23 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517c67f7-8e87-4721-a35e-d58afbcfa9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e900dcb5-a507-4be9-9778-9da7dafb9409', 'volume_name': 'volume-e900dcb5-a507-4be9-9778-9da7dafb9409', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d8e37d-cae4-48c8-a562-da89a3b8a6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d8e37d-cae4-48c8-a562-da89a3b8a6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9687df29-01fc-4234-8e2c-1a68092a10c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Volume e900dcb5-a507-4be9-9778-9da7dafb9409: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e900dcb5-a507-4be9-9778-9da7dafb9409', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Trying to clone e900dcb5-a507-4be9-9778-9da7dafb9409 from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:52:23 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.info" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-530fa586-bf07-455f-afce-a89a8558385e" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-530fa586-bf07-455f-afce-a89a8558385e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] snapshot: a7fc9d66-b631-4050-bd7b-bf165fe16de8, volume: 530fa586-bf07-455f-afce-a89a8558385e, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d386487-8141-40fb-baf8-09a75378c885]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:23 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d262ace4-e702-4f3e-9b65-e6ebe5400644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:23 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 Nov 02 11:52:23 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac84b789-033b-49db-bf12-f56995909059]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:52:23 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Image download 20.69 MB at 20.69 MB/s Nov 02 11:52:23 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 Nov 02 11:52:23 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[115ffe0a-b5c1-47ce-9bbc-816e2a7410c8]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:23 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8" returned: 0 in 0.482s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3cc943-3c83-497d-8ca2-61bb30d89201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3338e797-3a71-4821-8012-0e1ce6d4b10a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:23 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD Nov 02 11:52:23 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:23 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 Nov 02 11:52:23 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:24 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 is fetched for user 88bd4024435d471fa2b37b3b41b2c04a. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[228feb7c-f100-4774-b55f-439cb8e02983]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:24 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644" returned: 0 in 0.691s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:24 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a Nov 02 11:52:24 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:24 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:24 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD Nov 02 11:52:24 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:24 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e Nov 02 11:52:24 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:24 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:24 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a" returned: 0 in 0.380s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:24 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a Nov 02 11:52:24 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:24 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644.47304b0c-adf8-42b5-8fc5-b6fab17e196a" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-47304b0c-adf8-42b5-8fc5-b6fab17e196a" released by "_delete_snapshot" :: held 1.991s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-d262ace4-e702-4f3e-9b65-e6ebe5400644" released by "delete_snapshot" :: held 2.019s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:25 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['c2174225-abf7-4aa0-9cb0-afcdc5b23934', 'ad5ea9f5-b159-403c-8f37-3c491ba5e803', '4cae5e5a-5f39-4c8b-b51d-bd212ba448fb', '7683ce36-df08-45e2-a72f-77a417a52569'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Delete snapshot completed successfully. Nov 02 11:52:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4a170630-f2e5-4131-a593-369039d9e7a7 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-47304b0c-adf8-42b5-8fc5-b6fab17e196a-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-d262ace4-e702-4f3e-9b65-e6ebe5400644-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-d262ace4-e702-4f3e-9b65-e6ebe5400644-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-d262ace4-e702-4f3e-9b65-e6ebe5400644" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-d262ace4-e702-4f3e-9b65-e6ebe5400644" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3404b1-1fde-4a73-9dff-aed554cd8756]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:26 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 Nov 02 11:52:26 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:27 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644" returned: 0 in 0.590s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:27 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644 Nov 02 11:52:27 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:27 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d262ace4-e702-4f3e-9b65-e6ebe5400644" returned: 0 in 0.378s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-d262ace4-e702-4f3e-9b65-e6ebe5400644" released by "delete_volume" :: held 1.081s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['25cabd35-aa51-40b6-9d82-7b2e0e8ed54a', 'e3653870-09bf-4d4f-b87d-4e9515037aa9', '1001c441-4e63-46e7-9442-4ff8d36ab595', 'f1e76662-e214-4348-ac3f-c14babc6ef74'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:27 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:27 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:28 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:28 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Deleted volume successfully. Nov 02 11:52:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-252ca17c-9849-4308-8338-836590759ce9 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-d262ace4-e702-4f3e-9b65-e6ebe5400644-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (379d579e-2a2e-476a-87e3-9186b95f9c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8418b60a-aebe-4a67-971a-67f2013936f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8418b60a-aebe-4a67-971a-67f2013936f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-746976833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d78a1a5-8c7c-4111-af71-281c45d5199e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:29Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82889a0-c17c-4395-acd2-4bb9c5e37322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82889a0-c17c-4395-acd2-4bb9c5e37322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1750e19a-843f-43c5-adca-5fa5becb825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1750e19a-843f-43c5-adca-5fa5becb825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d78a1a5-8c7c-4111-af71-281c45d5199e', 'volume_name': 'volume-1d78a1a5-8c7c-4111-af71-281c45d5199e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d5393f-e356-49e2-9b61-6352c4cf24dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d5393f-e356-49e2-9b61-6352c4cf24dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b880c9a9-f4db-4d9d-835c-d28a46a159e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Volume 1d78a1a5-8c7c-4111-af71-281c45d5199e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d78a1a5-8c7c-4111-af71-281c45d5199e', 'volume_size': 1} Nov 02 11:52:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:31 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e" returned: 0 in 6.832s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:52:31 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Converted 1024.00 MB image at 149.85 MB/s Nov 02 11:52:31 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e is being set with open permissions: ugo+rw Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:31 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e Nov 02 11:52:31 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:31 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e" returned: 0 in 0.226s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-530fa586-bf07-455f-afce-a89a8558385e" released by "_copy_volume_from_snapshot" :: held 8.043s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-a7fc9d66-b631-4050-bd7b-bf165fe16de8" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-a7fc9d66-b631-4050-bd7b-bf165fe16de8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Deleting offline snapshot a7fc9d66-b631-4050-bd7b-bf165fe16de8 of volume 9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] snapshot_file for this snap is: volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71c7a4-15ee-4be1-8684-eeac5518e1e9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:31 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 Nov 02 11:52:31 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:31 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3cc943-3c83-497d-8ca2-61bb30d89201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[31306bf3-39fa-45e2-b2ad-bacb645f8e1a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:31 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 Nov 02 11:52:31 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:32 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201" returned: 0 in 0.527s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:32 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 Nov 02 11:52:32 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:32 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:32 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8 Nov 02 11:52:32 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:32 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201.a7fc9d66-b631-4050-bd7b-bf165fe16de8" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-a7fc9d66-b631-4050-bd7b-bf165fe16de8" released by "_delete_snapshot" :: held 1.568s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.984s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.957s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ab9fc3-ad54-40b2-85c5-3e32d02d8f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='723c16998ab54c24918de695da40182d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:08Z,use_quota=True,user_id='80851bfb0a8d43ce9eaebaffdece3f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7d6c066-9508-4d5c-852e-29510cfbb6e8),volume_type_id=c7d6c066-9508-4d5c-852e-29510cfbb6e8)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Creating volume 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:32 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:52:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:33 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 1073741824 Nov 02 11:52:33 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a32d9e6-4d4b-4174-b7ab-fd1f0a323992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530fa586-bf07-455f-afce-a89a8558385e', 'volume_size': 1, 'source_volid': '9c3cc943-3c83-497d-8ca2-61bb30d89201', 'source_volstatus': 'available'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebd62eb-de57-4b23-b8bb-233f2750262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:33 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Volume volume-530fa586-bf07-455f-afce-a89a8558385e (530fa586-bf07-455f-afce-a89a8558385e): created successfully Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebd62eb-de57-4b23-b8bb-233f2750262a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (36982707-9771-41ec-a6f4-92eb172bda16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c5632d6c-222f-496f-a8d8-eff1d98b8690 tempest-VolumesGetTest-169856308 None] Created volume successfully. Nov 02 11:52:33 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 1073741824" returned: 0 in 0.425s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:33 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 Nov 02 11:52:33 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:33 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.224s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-369849095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e900dcb5-a507-4be9-9778-9da7dafb9409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c230c50aac1346959137ae541d1af2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:23Z,use_quota=True,user_id='88bd4024435d471fa2b37b3b41b2c04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Creating volume e900dcb5-a507-4be9-9778-9da7dafb9409 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:33 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:33 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 1073741824 Nov 02 11:52:33 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Attempting download of 578a0c92-4da9-4e30-976a-35b5073d4f09 ((None, [{'url': 'file:///opt/stack/data/glance/images/578a0c92-4da9-4e30-976a-35b5073d4f09', 'metadata': {}}])) to volume 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb196c12-18a0-4787-91aa-55a83418d9cd]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_578a0c92-4da9-4e30-976a-35b5073d4f09_xbugo3w7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:33 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_578a0c92-4da9-4e30-976a-35b5073d4f09_xbugo3w7 Nov 02 11:52:33 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (ec5ad710-9ce7-4de0-a04f-a87c3e1ec307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fdc26f-4a84-45d6-a554-9142eff01c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fdc26f-4a84-45d6-a554-9142eff01c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-834364058',display_name='tempest-VolumesGetTest-Volume-623327139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10833fb-c518-478e-83b7-6346466a572f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:34Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4a8c4d-702b-48a4-8f50-004a09637a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4a8c4d-702b-48a4-8f50-004a09637a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e9d38a-2c43-4199-a83e-f4bfad537335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e9d38a-2c43-4199-a83e-f4bfad537335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10833fb-c518-478e-83b7-6346466a572f', 'volume_name': 'volume-f10833fb-c518-478e-83b7-6346466a572f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc1fc82-60cc-4617-8fdb-ea4c657a2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc1fc82-60cc-4617-8fdb-ea4c657a2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023fb0a1-5a31-427b-aeb3-4c356a3cdb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:34 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Volume f10833fb-c518-478e-83b7-6346466a572f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10833fb-c518-478e-83b7-6346466a572f', 'volume_size': 1} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:34 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_578a0c92-4da9-4e30-976a-35b5073d4f09_xbugo3w7" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_578a0c92-4da9-4e30-976a-35b5073d4f09_xbugo3w7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:34 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 1073741824" returned: 0 in 0.488s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:34 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 Nov 02 11:52:34 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:34 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_578a0c92-4da9-4e30-976a-35b5073d4f09_xbugo3w7 Nov 02 11:52:34 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:34 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409" returned: 0 in 0.238s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.893s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-746976833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d78a1a5-8c7c-4111-af71-281c45d5199e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:29Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Creating volume 1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:34 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:34 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_578a0c92-4da9-4e30-976a-35b5073d4f09_xbugo3w7" returned: 1 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_578a0c92-4da9-4e30-976a-35b5073d4f09_xbugo3w7' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[285fbac7-a1dd-4a28-aac9-cac555f13fb4]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:34 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e 1073741824 Nov 02 11:52:34 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Attempting download of 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume e900dcb5-a507-4be9-9778-9da7dafb9409. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6986e7-8b18-4a41-829f-f45004b2d62e]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_mz75lmhu {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:34 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD Nov 02 11:52:34 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:34 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_mz75lmhu Nov 02 11:52:34 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:34 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:34 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_mz75lmhu" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_mz75lmhu {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:34 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e 1073741824" returned: 0 in 0.501s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:35 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD Nov 02 11:52:35 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:35 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e Nov 02 11:52:35 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_mz75lmhu Nov 02 11:52:35 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] 578a0c92-4da9-4e30-976a-35b5073d4f09 was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:35 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e" returned: 0 in 0.258s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.195s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-834364058',display_name='tempest-VolumesGetTest-Volume-623327139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10833fb-c518-478e-83b7-6346466a572f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:34Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Creating volume f10833fb-c518-478e-83b7-6346466a572f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:35 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:35 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:35 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b880c9a9-f4db-4d9d-835c-d28a46a159e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d78a1a5-8c7c-4111-af71-281c45d5199e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:35 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f 1073741824 Nov 02 11:52:35 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196d22e0-aaad-4ee9-a01a-334cee71f64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_mz75lmhu" returned: 1 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_mz75lmhu' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84657c-5339-4740-bd00-583632278152]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Volume volume-1d78a1a5-8c7c-4111-af71-281c45d5199e (1d78a1a5-8c7c-4111-af71-281c45d5199e): created successfully Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196d22e0-aaad-4ee9-a01a-334cee71f64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (379d579e-2a2e-476a-87e3-9186b95f9c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6c144f42-9399-4c7d-9982-77fa1b32537a tempest-VolumesSnapshotTestJSON-1580625143 None] Created volume successfully. Nov 02 11:52:35 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD Nov 02 11:52:35 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:35 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 Nov 02 11:52:35 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50" returned: 0 in 0.568s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_578a0c92-4da9-4e30-976a-35b5073d4f09_9qu9vk7sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:52:35 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:35 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f 1073741824" returned: 0 in 0.549s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:35 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 1G Nov 02 11:52:35 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:35 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f Nov 02 11:52:35 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:36 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f" returned: 0 in 0.307s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.217s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023fb0a1-5a31-427b-aeb3-4c356a3cdb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10833fb-c518-478e-83b7-6346466a572f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8de234-a886-4a8b-9630-68cef33b74d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Creating offline snapshot 224987d7-f51a-4413-9958-e37b59733a9c of volume 1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:52:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Volume volume-f10833fb-c518-478e-83b7-6346466a572f (f10833fb-c518-478e-83b7-6346466a572f): created successfully Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8de234-a886-4a8b-9630-68cef33b74d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (ec5ad710-9ce7-4de0-a04f-a87c3e1ec307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7f7e61-c5ae-49b4-8edc-1e6b8d3424db]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:36 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 1G" returned: 0 in 0.481s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Downloaded image 578a0c92-4da9-4e30-976a-35b5073d4f09 ((None, [{'url': 'file:///opt/stack/data/glance/images/578a0c92-4da9-4e30-976a-35b5073d4f09', 'metadata': {}}])) to volume 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Temporary image 578a0c92-4da9-4e30-976a-35b5073d4f09 for user 80851bfb0a8d43ce9eaebaffdece3f50 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Marking volume 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:52:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ff95c123-74b6-4600-98a7-2c7144e4c282 tempest-VolumesGetTest-169856308 None] Created volume successfully. Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Copying metadata from image 578a0c92-4da9-4e30-976a-35b5073d4f09 to 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Creating volume glance metadata for volume 17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 backed by image 578a0c92-4da9-4e30-976a-35b5073d4f09 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '578a0c92-4da9-4e30-976a-35b5073d4f09', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e4f2b9ed8ab5b085b47fc52c17480d38', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f3596a-1008-4bd5-b2ee-c00346b92aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50', 'volume_size': 1, 'image_id': '578a0c92-4da9-4e30-976a-35b5073d4f09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/578a0c92-4da9-4e30-976a-35b5073d4f09', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4f2b9ed8ab5b085b47fc52c17480d38', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '723c16998ab54c24918de695da40182d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e594f79310a7a4e13ad0f9943e62333751857f3fd5a939ee0247db4b49c25c6e6c02f6b441a56a8e16b506e9fda060f8e5ae0625421fc904d71f58799f5f51e4', 'id': '578a0c92-4da9-4e30-976a-35b5073d4f09', 'created_at': datetime.datetime(2026, 11, 2, 10, 52, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 52, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/578a0c92-4da9-4e30-976a-35b5073d4f09/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f4516e-05b3-4d29-b47a-3065822426cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Volume volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 (17ab9fc3-ad54-40b2-85c5-3e32d02d8f50): created successfully Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f4516e-05b3-4d29-b47a-3065822426cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:36 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e Nov 02 11:52:36 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Flow 'volume_create_manager' (1065cb80-4ad4-41a7-a4ef-3329bcd0129b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e28c2c69-8ee4-4d42-8367-cd416e51d6b4 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Created volume successfully. Nov 02 11:52:36 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:36 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c 1G Nov 02 11:52:36 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Acquiring lock "cinder-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "cinder-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Acquiring lock "cinder-quobyte-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-f10833fb-c518-478e-83b7-6346466a572f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "cinder-quobyte-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Lock "cinder-f10833fb-c518-478e-83b7-6346466a572f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:37 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[497ecf21-e9a8-4492-955c-0b86bd90f4a9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c 1G" returned: 0 in 0.630s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d78a1a5-8c7c-4111-af71-281c45d5199e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:37 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d78a1a5-8c7c-4111-af71-281c45d5199e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c Nov 02 11:52:37 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-f10833fb-c518-478e-83b7-6346466a572f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-f10833fb-c518-478e-83b7-6346466a572f" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:37 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 Nov 02 11:52:37 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb7ac7-1811-4676-8138-5631715a4129]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:37 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f Nov 02 11:52:37 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:37 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d78a1a5-8c7c-4111-af71-281c45d5199e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c" returned: 0 in 0.407s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:37 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c is being set with open permissions: ugo+rw Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:37 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c Nov 02 11:52:37 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:37 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50" returned: 0 in 0.518s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:37 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409" returned: 0 in 2.212s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_e3ggesmldevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:52:37 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Converted 112.00 MB image at 50.58 MB/s Nov 02 11:52:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:37 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50 Nov 02 11:52:37 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:37 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 1G Nov 02 11:52:37 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:38 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:38 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f Nov 02 11:52:38 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:38 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:38 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.info Nov 02 11:52:38 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:38 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "cinder-quobyte-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50" released by "delete_volume" :: held 0.930s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:38 devstack cinder-volume[86846]: WARNING cinder.quota [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:52:38 devstack cinder-volume[86846]: WARNING cinder.quota [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Created reservations ['f5e7df14-1128-45d2-92c5-30755ef354cb', '71922f1f-5e1a-4f32-927f-49cbaca10d0e', 'e24985c7-f2a7-4105-acdc-b9761b5db307', 'ae6726b2-883f-4553-ae74-793486a0b1b0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:38 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 1G" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Downloaded image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume e900dcb5-a507-4be9-9778-9da7dafb9409 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 for user 88bd4024435d471fa2b37b3b41b2c04a is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Marking volume e900dcb5-a507-4be9-9778-9da7dafb9409 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:52:38 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f10833fb-c518-478e-83b7-6346466a572f" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Copying metadata from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 to e900dcb5-a507-4be9-9778-9da7dafb9409. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Creating volume glance metadata for volume e900dcb5-a507-4be9-9778-9da7dafb9409 backed by image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-f10833fb-c518-478e-83b7-6346466a572f" released by "delete_volume" :: held 0.895s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:38 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.info" returned: 0 in 0.301s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.info is being set with open permissions: ugo+rw Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:38 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.info Nov 02 11:52:38 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Created reservations ['af9d50e2-cf8d-4462-8285-2c5eafef07d7', '3996980f-f7e1-4d11-996f-1436b4c7d8a0', 'c2c05c0f-038e-453d-9a2e-068fa882634f', 'c1955f7e-d2eb-4803-bf86-91b91348df32'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:38 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:38 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9687df29-01fc-4234-8e2c-1a68092a10c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e900dcb5-a507-4be9-9778-9da7dafb9409', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3072e5-34b8-42fe-9858-807d5eb1ca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Volume volume-e900dcb5-a507-4be9-9778-9da7dafb9409 (e900dcb5-a507-4be9-9778-9da7dafb9409): created successfully Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3072e5-34b8-42fe-9858-807d5eb1ca11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Flow 'volume_create_manager' (6219abdb-cf4a-4c25-88b3-f0525d1a8c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-640bbf12-e2df-4e10-b01d-60f04f9545f3 tempest-VolumesExtendTest-1571885479 None] Created volume successfully. Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:38 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:38 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:38 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.info" returned: 0 in 0.283s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:38 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.285s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Deleted volume successfully. Nov 02 11:52:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1349ccef-3384-4f8c-9ff9-ba9f62c6da4d tempest-VolumesSnapshotTestJSON-1580625143 None] Create snapshot completed successfully Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca6520d5-5828-4a06-8d14-1de9cc3de4b2 tempest-VolumeAndVolumeTypeFromImageTest-881090461 None] Lock "cinder-17ab9fc3-ad54-40b2-85c5-3e32d02d8f50-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:38 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.246s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Deleted volume successfully. Nov 02 11:52:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0ac1ccd0-02de-4470-89ca-8fbf41fe4445 tempest-VolumesGetTest-169856308 None] Lock "cinder-f10833fb-c518-478e-83b7-6346466a572f-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[27441d47-9beb-4920-bbf5-74980416d1dc]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:39 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 Nov 02 11:52:39 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:39 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 2G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 2G" returned: 0 in 0.182s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.589s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-97b32655-34e2-4a0b-ba79-75b71129324c tempest-VolumesExtendTest-1571885479 None] Extend volume completed successfully. Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-530fa586-bf07-455f-afce-a89a8558385e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Lock "cinder-530fa586-bf07-455f-afce-a89a8558385e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (2cb706ba-4e0e-4520-b83f-d7cc731afdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff81ad84-6e69-4bde-aa55-b7d6896a5989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-530fa586-bf07-455f-afce-a89a8558385e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff81ad84-6e69-4bde-aa55-b7d6896a5989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-743058462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bab4e10-1192-42aa-a986-d38223cf1be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7f899429644ddebd560f0c81413988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=224987d7-f51a-4413-9958-e37b59733a9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:40Z,use_quota=True,user_id='a841c145779b4c80bf5f5f34bd4072ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2a2c75-5c6d-47de-824b-ba242da0883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2a2c75-5c6d-47de-824b-ba242da0883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ab9e72-7b11-4ba9-b99b-e6faeebc3bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ab9e72-7b11-4ba9-b99b-e6faeebc3bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6bab4e10-1192-42aa-a986-d38223cf1be5', 'volume_name': 'volume-6bab4e10-1192-42aa-a986-d38223cf1be5', 'volume_size': 1, 'snapshot_id': '224987d7-f51a-4413-9958-e37b59733a9c'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d83d54-8e00-40cb-848b-95102ef55574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d83d54-8e00-40cb-848b-95102ef55574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78d8127-0021-4f5a-b604-cd469dbced3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Volume 6bab4e10-1192-42aa-a986-d38223cf1be5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6bab4e10-1192-42aa-a986-d38223cf1be5', 'volume_size': 1, 'snapshot_id': '224987d7-f51a-4413-9958-e37b59733a9c'} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-224987d7-f51a-4413-9958-e37b59733a9c-6bab4e10-1192-42aa-a986-d38223cf1be5" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-530fa586-bf07-455f-afce-a89a8558385e" acquired by "delete_volume" :: waited 0.067s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-224987d7-f51a-4413-9958-e37b59733a9c-6bab4e10-1192-42aa-a986-d38223cf1be5" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Creating volume 6bab4e10-1192-42aa-a986-d38223cf1be5 from snapshot 224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-6bab4e10-1192-42aa-a986-d38223cf1be5" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d74866-0f5f-4f9c-90da-d77213eaabd7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-6bab4e10-1192-42aa-a986-d38223cf1be5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] snapshot: 224987d7-f51a-4413-9958-e37b59733a9c, volume: 6bab4e10-1192-42aa-a986-d38223cf1be5, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ced65b-93a8-4e8d-b0eb-14141ce43473]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:40 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e Nov 02 11:52:40 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:40 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c Nov 02 11:52:40 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:40 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:40 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e Nov 02 11:52:40 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:40 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d78a1a5-8c7c-4111-af71-281c45d5199e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4944b8-5b2c-450b-a8fe-9186c1b5a261]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:40 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e Nov 02 11:52:40 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:40 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-530fa586-bf07-455f-afce-a89a8558385e" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "cinder-e900dcb5-a507-4be9-9778-9da7dafb9409-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-530fa586-bf07-455f-afce-a89a8558385e" released by "delete_volume" :: held 0.864s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-e900dcb5-a507-4be9-9778-9da7dafb9409-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "cinder-quobyte-e900dcb5-a507-4be9-9778-9da7dafb9409" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-e900dcb5-a507-4be9-9778-9da7dafb9409" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Created reservations ['091583f2-3f49-404d-bd3c-5e9d17e4a511', 'a5b1b567-2c73-4841-99de-5e29630573f9', 'fbd2da84-7306-4d89-9c9d-855aba4dc2c1', 'e5de77e1-7a84-4e13-a0a0-0cd6253457a7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fc9e12-b3bb-4ef3-9485-164d28c395e7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:40 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e" returned: 0 in 0.460s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:41 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 Nov 02 11:52:41 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:41 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:41 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:41 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 Nov 02 11:52:41 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:41 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.316s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Deleted volume successfully. Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9752988e-deef-4514-a40d-a9f1cb146079 tempest-VolumesGetTest-169856308 None] Lock "cinder-530fa586-bf07-455f-afce-a89a8558385e-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:41 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409" returned: 0 in 0.505s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:41 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409 Nov 02 11:52:41 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:41 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e900dcb5-a507-4be9-9778-9da7dafb9409" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-e900dcb5-a507-4be9-9778-9da7dafb9409" released by "delete_volume" :: held 1.060s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Created reservations ['7dfb88ba-1c2f-41ed-9bbf-016c6e862367', '1d3beb0f-2e11-465d-87b9-18dae8604b35', 'c764da29-2ead-46d7-b419-fd3cd0fb934d', 'fc261be6-cbcb-4197-bc62-61105fa24036'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:42 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:42 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-9c3cc943-3c83-497d-8ca2-61bb30d89201-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Lock "cinder-9c3cc943-3c83-497d-8ca2-61bb30d89201-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-9c3cc943-3c83-497d-8ca2-61bb30d89201" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-9c3cc943-3c83-497d-8ca2-61bb30d89201" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b41e3-b767-4ca4-96d5-02cd78e6c65f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:42 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 Nov 02 11:52:42 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:42 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.640s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Deleted volume successfully. Nov 02 11:52:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6f92dc1a-55ad-4c2c-98a8-727c01e52113 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-e900dcb5-a507-4be9-9778-9da7dafb9409-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:43 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201" returned: 0 in 0.748s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:43 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201 Nov 02 11:52:43 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:43 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9c3cc943-3c83-497d-8ca2-61bb30d89201" returned: 0 in 0.530s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-9c3cc943-3c83-497d-8ca2-61bb30d89201" released by "delete_volume" :: held 1.455s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Created reservations ['d32b0aaf-bda6-4ce3-90ce-382e319e0d70', '00ba3dd9-3abb-4a87-b509-88b3aaa7ec7b', '6e52266a-c6e2-41f4-9cea-4a8b9790ac8f', '7226c28b-1ab8-46a6-b20b-a0f97dd8a29a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Flow 'volume_create_manager' (31a71354-e14d-4835-a1d2-347179c2d5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9de3e1f-8969-4524-8640-b6266906c3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9de3e1f-8969-4524-8640-b6266906c3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-996811292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c230c50aac1346959137ae541d1af2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:44Z,use_quota=True,user_id='88bd4024435d471fa2b37b3b41b2c04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cd97de-0a0c-4b52-bf2b-e9bfa2c66786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cd97de-0a0c-4b52-bf2b-e9bfa2c66786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c6b7f-90c0-49f1-a913-aaab0c8c5fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c6b7f-90c0-49f1-a913-aaab0c8c5fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899', 'volume_name': 'volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4550085-5036-49bc-8032-6cd57b811ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4550085-5036-49bc-8032-6cd57b811ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1343c1c8-3bf0-45e4-95eb-c31accd7438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Volume 28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899', 'volume_size': 1} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:44 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:44 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:44 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.474s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Deleted volume successfully. Nov 02 11:52:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f304f583-8080-42b1-99f4-d43bda8d1d1b tempest-VolumesGetTest-169856308 None] Lock "cinder-9c3cc943-3c83-497d-8ca2-61bb30d89201-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (9489de3d-a253-4479-b0d9-f8e664c45eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5366cd0e-0eea-4c84-bdb1-ea68fb9d9bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5366cd0e-0eea-4c84-bdb1-ea68fb9d9bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-484282810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430d59ba-3c27-4855-b8e5-fa28cf6a1075,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:46Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f7005d-7017-41da-8685-d5bbe789689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f7005d-7017-41da-8685-d5bbe789689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13716be9-3df8-4962-a6df-812e4f5d54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13716be9-3df8-4962-a6df-812e4f5d54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '430d59ba-3c27-4855-b8e5-fa28cf6a1075', 'volume_name': 'volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cf6187-cf6a-4c11-bcc7-bc8f31b97ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cf6187-cf6a-4c11-bcc7-bc8f31b97ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053d7de2-5349-42a7-84d7-fdfcebc27107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Volume 430d59ba-3c27-4855-b8e5-fa28cf6a1075: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 11:52:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Trying to clone 430d59ba-3c27-4855-b8e5-fa28cf6a1075 from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:52:47 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:52:47 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Image download 20.69 MB at 20.69 MB/s Nov 02 11:52:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ec635-17a8-4a76-91dd-68603db8a4d5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:47 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD Nov 02 11:52:47 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:48 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:48 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 is fetched for user adf673e21288492eaf16b960b712a53e. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:52:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3940043-0809-493f-a0db-435a1c60e269]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:48 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD Nov 02 11:52:48 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:49 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:50 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5" returned: 0 in 8.983s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:52:50 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Converted 1024.00 MB image at 113.98 MB/s Nov 02 11:52:50 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 is being set with open permissions: ugo+rw Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:50 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 Nov 02 11:52:50 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:50 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-6bab4e10-1192-42aa-a986-d38223cf1be5" released by "_copy_volume_from_snapshot" :: held 10.264s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-224987d7-f51a-4413-9958-e37b59733a9c-6bab4e10-1192-42aa-a986-d38223cf1be5" released by "_create_volume_from_snapshot" :: held 10.338s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.367s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-996811292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c230c50aac1346959137ae541d1af2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:44Z,use_quota=True,user_id='88bd4024435d471fa2b37b3b41b2c04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Creating volume 28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:50 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:50 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 1073741824 Nov 02 11:52:50 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78d8127-0021-4f5a-b604-cd469dbced3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bab4e10-1192-42aa-a986-d38223cf1be5', 'volume_size': 1, 'snapshot_id': '224987d7-f51a-4413-9958-e37b59733a9c'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41f47b8-9326-41cc-9479-9550c2758003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Volume volume-6bab4e10-1192-42aa-a986-d38223cf1be5 (6bab4e10-1192-42aa-a986-d38223cf1be5): created successfully Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41f47b8-9326-41cc-9479-9550c2758003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Flow 'volume_create_manager' (2cb706ba-4e0e-4520-b83f-d7cc731afdca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-489d5541-ddda-4191-b541-a2bb62cc49d1 tempest-VolumesSnapshotTestJSON-1580625143 None] Created volume successfully. Nov 02 11:52:50 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 1073741824" returned: 0 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:50 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 Nov 02 11:52:50 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-6bab4e10-1192-42aa-a986-d38223cf1be5-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-6bab4e10-1192-42aa-a986-d38223cf1be5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-6bab4e10-1192-42aa-a986-d38223cf1be5" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-6bab4e10-1192-42aa-a986-d38223cf1be5" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ed42f7-a3db-44f2-af1d-f82f41e3631a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:51 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-484282810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430d59ba-3c27-4855-b8e5-fa28cf6a1075,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:46Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Creating volume 430d59ba-3c27-4855-b8e5-fa28cf6a1075 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:51 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1343c1c8-3bf0-45e4-95eb-c31accd7438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:51 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 1073741824 Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1a4560-1422-4ba7-945f-f74e85963f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:51 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Volume volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 (28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899): created successfully Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1a4560-1422-4ba7-945f-f74e85963f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Flow 'volume_create_manager' (31a71354-e14d-4835-a1d2-347179c2d5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ed567762-704d-4e6f-a1a4-ed9697fab820 tempest-VolumesExtendTest-1571885479 None] Created volume successfully. Nov 02 11:52:51 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 Nov 02 11:52:51 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:51 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:51 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5 Nov 02 11:52:51 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:51 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 1073741824" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:51 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 Nov 02 11:52:51 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:51 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6bab4e10-1192-42aa-a986-d38223cf1be5" returned: 0 in 0.324s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-6bab4e10-1192-42aa-a986-d38223cf1be5" released by "delete_volume" :: held 0.783s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['321c6e1a-fcca-4aa6-b404-bd8775885783', '5409a8ee-ead5-4646-9ca1-ded11c1c24a4', '09995cc0-6de9-40d9-a591-3211ca664d85', 'a48ed095-d027-43e9-9631-6cd9ff5693e0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:52 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:52 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:52 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075" returned: 0 in 0.310s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Attempting download of 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 430d59ba-3c27-4855-b8e5-fa28cf6a1075. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Creating offline snapshot 15d9c105-409e-4431-9763-493386ecfa58 of volume 28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c78dd57-fd17-4161-b83f-7a93b5fb5bd9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba11aa-2a8f-467c-b1e7-99277b0c673e]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_2k9q9i9w {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-224987d7-f51a-4413-9958-e37b59733a9c-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-224987d7-f51a-4413-9958-e37b59733a9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-1d78a1a5-8c7c-4111-af71-281c45d5199e" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:52 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 Nov 02 11:52:52 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-1d78a1a5-8c7c-4111-af71-281c45d5199e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-224987d7-f51a-4413-9958-e37b59733a9c" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:52 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_2k9q9i9w Nov 02 11:52:52 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-224987d7-f51a-4413-9958-e37b59733a9c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:52 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Deleting offline snapshot 224987d7-f51a-4413-9958-e37b59733a9c of volume 1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] snapshot_file for this snap is: volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Deleted volume successfully. Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37673a9-7f8f-4b0f-8185-6b43f2a294c2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6428039b-4dd8-4e05-b2d3-69f321cb5969 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-6bab4e10-1192-42aa-a986-d38223cf1be5-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:52 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c Nov 02 11:52:52 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:52 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:52 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_2k9q9i9w" returned: 0 in 0.469s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_2k9q9i9w {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:52 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 1G Nov 02 11:52:52 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:52 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_2k9q9i9w Nov 02 11:52:52 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:52 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d78a1a5-8c7c-4111-af71-281c45d5199e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7edcdb9-6398-4b4b-8855-a40fcdad8c15]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:53 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_2k9q9i9w" returned: 1 in 0.574s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_2k9q9i9w' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9663d1-b7ef-44be-bd91-6ff21a063eae]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:53 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e Nov 02 11:52:53 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:53 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 1G" returned: 0 in 0.739s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:53 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD Nov 02 11:52:53 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:53 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 Nov 02 11:52:53 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:53 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:53 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 Nov 02 11:52:53 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:53 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e" returned: 0 in 0.717s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:53 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c Nov 02 11:52:53 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:53 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:53 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 is being set with open permissions: ugo+rw Nov 02 11:52:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:53 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 Nov 02 11:52:53 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:54 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:54 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58" returned: 0 in 0.326s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c" returned: 0 in 0.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:54 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c Nov 02 11:52:54 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:54 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.info Nov 02 11:52:54 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:54 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e.224987d7-f51a-4413-9958-e37b59733a9c" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:54 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.info" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:54 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.info is being set with open permissions: ugo+rw Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-224987d7-f51a-4413-9958-e37b59733a9c" released by "_delete_snapshot" :: held 2.273s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-1d78a1a5-8c7c-4111-af71-281c45d5199e" released by "delete_snapshot" :: held 2.318s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:54 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.info Nov 02 11:52:54 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['bdd5118a-0d91-4e8a-b412-764d9f95efe5', 'd7956304-831a-41bf-80f9-d35bfe2c5357', '00f80e41-63f4-4db5-93aa-78127fb841d7', '85a32d43-1fb4-49fb-be02-a13ea934f78b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Delete snapshot completed successfully. Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-970e6531-ae12-4be1-8157-ea486094faee tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-224987d7-f51a-4413-9958-e37b59733a9c-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:54 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.info" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7b523391-00c1-475b-ae59-eee21dc07e12 tempest-VolumesExtendTest-1571885479 None] Create snapshot completed successfully Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba5da52-28d7-4521-a2b6-6b619f14b7c7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:55 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 Nov 02 11:52:55 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-1d78a1a5-8c7c-4111-af71-281c45d5199e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-1d78a1a5-8c7c-4111-af71-281c45d5199e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-1d78a1a5-8c7c-4111-af71-281c45d5199e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-1d78a1a5-8c7c-4111-af71-281c45d5199e" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[873dbf7c-fa15-4cea-8b9f-2bbc20732944]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:56 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" returned: 0 in 0.636s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 2G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:56 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e Nov 02 11:52:56 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:56 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075" returned: 0 in 2.522s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_g5823nzfdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:52:56 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Converted 112.00 MB image at 44.38 MB/s Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:56 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 1G Nov 02 11:52:56 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 2G" returned: 0 in 0.193s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.883s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-801d5273-afb1-445d-84ed-d2461472b037 tempest-VolumesExtendTest-1571885479 None] Extend volume completed successfully. Nov 02 11:52:56 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:56 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e Nov 02 11:52:56 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:56 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 1G" returned: 0 in 0.469s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Downloaded image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 430d59ba-3c27-4855-b8e5-fa28cf6a1075 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 for user adf673e21288492eaf16b960b712a53e is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Marking volume 430d59ba-3c27-4855-b8e5-fa28cf6a1075 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Copying metadata from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 to 430d59ba-3c27-4855-b8e5-fa28cf6a1075. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Creating volume glance metadata for volume 430d59ba-3c27-4855-b8e5-fa28cf6a1075 backed by image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "cinder-15d9c105-409e-4431-9763-493386ecfa58-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-15d9c105-409e-4431-9763-493386ecfa58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "cinder-quobyte-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "cinder-quobyte-15d9c105-409e-4431-9763-493386ecfa58" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:56 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1d78a1a5-8c7c-4111-af71-281c45d5199e" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-15d9c105-409e-4431-9763-493386ecfa58" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Deleting offline snapshot 15d9c105-409e-4431-9763-493386ecfa58 of volume 28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] snapshot_file for this snap is: volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-1d78a1a5-8c7c-4111-af71-281c45d5199e" released by "delete_volume" :: held 1.006s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc919b57-cf76-4d10-9799-bfc75d0bb5f4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053d7de2-5349-42a7-84d7-fdfcebc27107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be6f51-6b0f-4b67-84a4-e63e1ab9b536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Volume volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 (430d59ba-3c27-4855-b8e5-fa28cf6a1075): created successfully Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be6f51-6b0f-4b67-84a4-e63e1ab9b536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (9489de3d-a253-4479-b0d9-f8e664c45eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-58c69738-97b8-4294-9c9d-a19148da2d9e tempest-VolumesGetTest-169856308 None] Created volume successfully. Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['b2153abb-5e5e-46b5-bbc3-10bfe47e7aff', 'af80fb91-2c8b-4910-aa3a-f6a4fbca8d4d', 'ebe73858-5927-4624-a3c8-7708c8f26bf0', 'f2708741-f131-41f3-8627-bd1db6fc9c55'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:57 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 Nov 02 11:52:57 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:57 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:57 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:57 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:52:57 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:52:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Deleted volume successfully. Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ca8cc8-c28a-410f-8f3c-3f0b0cb0db01]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1605c1ab-9255-4288-bd10-232a2c37bc87 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-1d78a1a5-8c7c-4111-af71-281c45d5199e-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:57 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 Nov 02 11:52:57 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:57 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" returned: 0 in 0.386s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:57 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 Nov 02 11:52:57 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-8b480099-663e-4b40-bf92-a88eab0e8c03-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-8b480099-663e-4b40-bf92-a88eab0e8c03-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "cinder-quobyte-8b480099-663e-4b40-bf92-a88eab0e8c03" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-8b480099-663e-4b40-bf92-a88eab0e8c03" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:52:58 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58" returned: 0 in 0.615s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8d8d9-4f78-4115-ad48-6c8b0bb29626]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:58 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58 Nov 02 11:52:58 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:58 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 Nov 02 11:52:58 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:52:58 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (cd09dc3d-4a13-4ab1-a338-f6274551efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fc9ff0-5695-490e-9f53-b7f9dc1337de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899.15d9c105-409e-4431-9763-493386ecfa58" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:59 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fc9ff0-5695-490e-9f53-b7f9dc1337de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1485845968',display_name='tempest-VolumesGetTest-Volume-431024958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c78c33-88b1-477f-9648-a2924b64bfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:59Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a7b585-5e4f-4703-9199-9dc41bcbc11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a7b585-5e4f-4703-9199-9dc41bcbc11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bac3eb-2ce0-4faa-8302-4507fa5abb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bac3eb-2ce0-4faa-8302-4507fa5abb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c78c33-88b1-477f-9648-a2924b64bfbb', 'volume_name': 'volume-99c78c33-88b1-477f-9648-a2924b64bfbb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e9eb5-f8a9-4071-ab2d-1dca897c80f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e9eb5-f8a9-4071-ab2d-1dca897c80f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793e9c59-d96e-40b3-a068-3bba33aa5213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:52:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Volume 99c78c33-88b1-477f-9648-a2924b64bfbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c78c33-88b1-477f-9648-a2924b64bfbb', 'volume_size': 1} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:52:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1485845968',display_name='tempest-VolumesGetTest-Volume-431024958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c78c33-88b1-477f-9648-a2924b64bfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a1dc9d218436a965889657f26e478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:52:59Z,use_quota=True,user_id='adf673e21288492eaf16b960b712a53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Creating volume 99c78c33-88b1-477f-9648-a2924b64bfbb {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:52:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-15d9c105-409e-4431-9763-493386ecfa58" released by "_delete_snapshot" :: held 2.238s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03" returned: 0 in 0.691s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:59 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb 1073741824 Nov 02 11:52:59 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" released by "delete_snapshot" :: held 2.308s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:59 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03 Nov 02 11:52:59 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Created reservations ['8b3a6fcc-8390-4f7a-b3dd-d1403b44207e', 'f887aea0-c8f4-4596-983f-79187ea8c6c9', '4fb8a85e-fc55-4906-a920-7f4a1f8e9782', '3dd3f1d0-ca8a-4768-801f-069f81823782'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Delete snapshot completed successfully. Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a5e09a7e-9bd1-4888-bc85-c10bc31bd9e5 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-15d9c105-409e-4431-9763-493386ecfa58-delete_snapshot" released by "delete_snapshot" :: held 2.667s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:59 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8b480099-663e-4b40-bf92-a88eab0e8c03" returned: 0 in 0.484s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-quobyte-8b480099-663e-4b40-bf92-a88eab0e8c03" released by "delete_volume" :: held 1.278s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Created reservations ['e6358639-5973-466a-83c3-32ba2627eae2', '550c7f21-2a53-4569-b2ae-9e6116e4e198', '31cfdd1a-7e26-4ae1-acb5-93fc27aa8d44', 'e5dfacd6-516e-4aeb-b441-0bbcb34f2e57'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:59 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb 1073741824" returned: 0 in 0.677s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:52:59 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:52:59 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:52:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:52:59 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb Nov 02 11:52:59 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "cinder-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:00 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.432s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:53:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Deleted volume successfully. Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "cinder-quobyte-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1953ce02-89b5-49a0-9e71-6386b6fd4d77 tempest-VolumesSnapshotTestJSON-1580625143 None] Lock "cinder-8b480099-663e-4b40-bf92-a88eab0e8c03-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:00 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793e9c59-d96e-40b3-a068-3bba33aa5213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c78c33-88b1-477f-9648-a2924b64bfbb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f3bbdd-8cab-44fb-8cc1-fb72a7efdbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e084ff6b-0194-4aba-9e68-b6d30b5e5e25]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Volume volume-99c78c33-88b1-477f-9648-a2924b64bfbb (99c78c33-88b1-477f-9648-a2924b64bfbb): created successfully Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f3bbdd-8cab-44fb-8cc1-fb72a7efdbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Flow 'volume_create_manager' (cd09dc3d-4a13-4ab1-a338-f6274551efc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f099bd8e-1224-4f86-b672-9d1312feb83b tempest-VolumesGetTest-169856308 None] Created volume successfully. Nov 02 11:53:00 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 Nov 02 11:53:00 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:00 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" returned: 0 in 0.452s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:00 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899 Nov 02 11:53:00 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:01 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-quobyte-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899" released by "delete_volume" :: held 0.828s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Created reservations ['3421e5ad-da15-4535-91c4-e21717667c71', '6f756dfb-5a62-4ae3-bed5-0986621aed5a', '39e0418f-2a3a-41dd-bc72-94af19f61eca', 'b81442d0-5f0e-4616-9fd3-0b35e9181dee'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-99c78c33-88b1-477f-9648-a2924b64bfbb-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Lock "cinder-99c78c33-88b1-477f-9648-a2924b64bfbb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:01 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:53:01 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-99c78c33-88b1-477f-9648-a2924b64bfbb" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-99c78c33-88b1-477f-9648-a2924b64bfbb" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e9a05-e625-4094-8211-668132ed19f5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:01 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb Nov 02 11:53:01 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:01 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:53:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Deleted volume successfully. Nov 02 11:53:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-488871cd-ab5e-4131-8d29-bececa827038 tempest-VolumesExtendTest-1571885479 None] Lock "cinder-28f2f9a3-34fb-4e73-b2b1-c6d7bf4a5899-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:02 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb" returned: 0 in 0.625s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:02 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb Nov 02 11:53:02 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:02 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-99c78c33-88b1-477f-9648-a2924b64bfbb" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-99c78c33-88b1-477f-9648-a2924b64bfbb" released by "delete_volume" :: held 1.085s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Created reservations ['8c89b8e0-f509-4d73-b036-542b5091f10f', 'e3afdd08-9533-46bb-bd9a-e18c2086f35a', '168f2005-c81a-43ee-a213-9c9943937104', '2d8017de-153d-4d4e-83e0-6b915ad76f03'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:02 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:53:02 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:02 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:53:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Deleted volume successfully. Nov 02 11:53:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08b07c7a-32b0-4727-adfe-6564ac4a7111 tempest-VolumesGetTest-169856308 None] Lock "cinder-99c78c33-88b1-477f-9648-a2924b64bfbb-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-430d59ba-3c27-4855-b8e5-fa28cf6a1075-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Lock "cinder-430d59ba-3c27-4855-b8e5-fa28cf6a1075-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Acquiring lock "cinder-quobyte-430d59ba-3c27-4855-b8e5-fa28cf6a1075" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-430d59ba-3c27-4855-b8e5-fa28cf6a1075" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b5d5d-5dc5-4c4d-979c-3949849a8aea]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:03 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 Nov 02 11:53:03 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:04 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075" returned: 0 in 0.458s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:04 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075 Nov 02 11:53:04 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:04 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-430d59ba-3c27-4855-b8e5-fa28cf6a1075" returned: 0 in 0.316s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Lock "cinder-quobyte-430d59ba-3c27-4855-b8e5-fa28cf6a1075" released by "delete_volume" :: held 0.823s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Created reservations ['dc1c27b3-dc29-4f28-99ce-3dfbe29df452', '25837c56-d214-4082-9351-eadc0785ea95', 'aedec483-f344-49a1-a336-4e075714b113', 'ba943f57-ed22-4b75-8dcd-2941dbf0c7fe'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:04 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:53:04 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:05 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:53:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Deleted volume successfully. Nov 02 11:53:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-48431021-0b7d-4a98-ab7c-01ce6a2fba57 tempest-VolumesGetTest-169856308 None] Lock "cinder-430d59ba-3c27-4855-b8e5-fa28cf6a1075-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=141,cinder:INSERT=69,cinder:UPDATE=187,cinder:DELETE=15 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=152,cinder:UPDATE=180,cinder:DELETE=13,cinder:INSERT=54 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Flow 'volume_create_manager' (43b01b79-cc9e-4e92-850c-38f6c17efab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360174e2-a71b-457f-a15c-409cbf13abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360174e2-a71b-457f-a15c-409cbf13abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-555568951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6bf150-ad25-47f5-a059-5700fc0b4046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5f4468b24549f3b2d91c5539de8448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:53:14Z,use_quota=True,user_id='fd6912e2590543d1b2369bf96e27709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc857c7-66a7-4b8a-8972-64783ba4f71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc857c7-66a7-4b8a-8972-64783ba4f71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52af46ed-144d-464e-a0a3-4a8aa4e4d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52af46ed-144d-464e-a0a3-4a8aa4e4d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6bf150-ad25-47f5-a059-5700fc0b4046', 'volume_name': 'volume-8d6bf150-ad25-47f5-a059-5700fc0b4046', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f8b14f-c5a8-4908-8c0e-2e9a0a753565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f8b14f-c5a8-4908-8c0e-2e9a0a753565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a2ea44-0e91-42b3-a95d-bec69bc7c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Volume 8d6bf150-ad25-47f5-a059-5700fc0b4046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6bf150-ad25-47f5-a059-5700fc0b4046', 'volume_size': 1} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-555568951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6bf150-ad25-47f5-a059-5700fc0b4046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5f4468b24549f3b2d91c5539de8448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:53:14Z,use_quota=True,user_id='fd6912e2590543d1b2369bf96e27709d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Creating volume 8d6bf150-ad25-47f5-a059-5700fc0b4046 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:53:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:53:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:13 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 1073741824 Nov 02 11:53:13 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Flow 'volume_create_manager' (1aad6fcc-de8e-4818-a73e-8ea6028481c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010482ba-d159-4595-9b14-b4edc7b117c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010482ba-d159-4595-9b14-b4edc7b117c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-586242912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f5b810-1c25-4de2-b80f-633542dbbd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71775e1cbd0541ed9d370474028d7395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:53:14Z,use_quota=True,user_id='566628ff28f44f9095e11adfb009b9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07730277-adba-445b-bba4-2abda83db500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07730277-adba-445b-bba4-2abda83db500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a318f15c-040e-45a8-9f87-6b17888f3d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a318f15c-040e-45a8-9f87-6b17888f3d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f5b810-1c25-4de2-b80f-633542dbbd71', 'volume_name': 'volume-a7f5b810-1c25-4de2-b80f-633542dbbd71', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7fed4d-1af2-4ed1-a95f-f36f2062645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7fed4d-1af2-4ed1-a95f-f36f2062645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a3a579-5e80-4ec8-b4e4-efdfd4ced66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Volume a7f5b810-1c25-4de2-b80f-633542dbbd71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f5b810-1c25-4de2-b80f-633542dbbd71', 'volume_size': 1} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:14 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 1073741824" returned: 0 in 0.781s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:14 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 Nov 02 11:53:14 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:15 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046" returned: 0 in 0.343s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-586242912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f5b810-1c25-4de2-b80f-633542dbbd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71775e1cbd0541ed9d370474028d7395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:53:14Z,use_quota=True,user_id='566628ff28f44f9095e11adfb009b9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Creating volume a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:53:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a2ea44-0e91-42b3-a95d-bec69bc7c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6bf150-ad25-47f5-a059-5700fc0b4046', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:15 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 1073741824 Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1dd206-b0af-4684-a09b-6b292c91db06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:15 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Volume volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 (8d6bf150-ad25-47f5-a059-5700fc0b4046): created successfully Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1dd206-b0af-4684-a09b-6b292c91db06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Flow 'volume_create_manager' (43b01b79-cc9e-4e92-850c-38f6c17efab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-96a4e2dc-24d1-42c9-b13f-002df47c8dbd tempest-VolumesNegativeTest-1686561718 None] Created volume successfully. Nov 02 11:53:15 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 1073741824" returned: 0 in 0.653s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:15 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 Nov 02 11:53:15 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:16 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a3a579-5e80-4ec8-b4e4-efdfd4ced66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f5b810-1c25-4de2-b80f-633542dbbd71', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98093cb-b97b-4acb-a745-5adfc80b983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Volume volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 (a7f5b810-1c25-4de2-b80f-633542dbbd71): created successfully Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98093cb-b97b-4acb-a745-5adfc80b983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Flow 'volume_create_manager' (1aad6fcc-de8e-4818-a73e-8ea6028481c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2ed4c1e4-09df-43fe-a237-efb205c613a3 tempest-SnapshotDependencyTests-1149436391 None] Created volume successfully. Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Creating offline snapshot 53505d1d-6e15-4633-8429-b3ca2e780c45 of volume a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[43566082-050c-4221-ac2d-b6e2a65c4f56]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:17 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 Nov 02 11:53:17 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:17 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71" returned: 0 in 0.456s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:17 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 1G Nov 02 11:53:17 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:17 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 1G" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:17 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 Nov 02 11:53:17 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:18 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45" returned: 0 in 0.335s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:18 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 is being set with open permissions: ugo+rw Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:18 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 Nov 02 11:53:18 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:18 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:18 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.info Nov 02 11:53:18 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:18 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.info" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:18 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.info is being set with open permissions: ugo+rw Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:18 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.info Nov 02 11:53:18 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:18 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:53:19 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:19 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.info" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-63277689-6e22-4131-9902-e5c64bf43e1d tempest-SnapshotDependencyTests-1149436391 None] Create snapshot completed successfully Nov 02 11:53:19 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.390s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:53:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:53:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 28 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:53:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Flow 'volume_create_manager' (a4e39a96-6f66-45dc-a266-216bc0eccb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407b73b8-50f3-4fe8-8b34-2839a743e0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407b73b8-50f3-4fe8-8b34-2839a743e0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71775e1cbd0541ed9d370474028d7395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53505d1d-6e15-4633-8429-b3ca2e780c45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:53:21Z,use_quota=True,user_id='566628ff28f44f9095e11adfb009b9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdc7be9-3732-4c46-b3b9-4110c76c2ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdc7be9-3732-4c46-b3b9-4110c76c2ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1b0d11-b3cc-42de-9148-adc8109c9b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1b0d11-b3cc-42de-9148-adc8109c9b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c', 'volume_name': 'volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c', 'volume_size': 1, 'snapshot_id': '53505d1d-6e15-4633-8429-b3ca2e780c45'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7159e337-8c8f-4e52-9ef1-cb2ff45e9a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7159e337-8c8f-4e52-9ef1-cb2ff45e9a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93ea720-fd62-416e-b288-d9f56f64eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Volume ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c', 'volume_size': 1, 'snapshot_id': '53505d1d-6e15-4633-8429-b3ca2e780c45'} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-quobyte-53505d1d-6e15-4633-8429-b3ca2e780c45-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-53505d1d-6e15-4633-8429-b3ca2e780c45-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Creating volume ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c from snapshot 53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-quobyte-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] snapshot: 53505d1d-6e15-4633-8429-b3ca2e780c45, volume: ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f24e9f-1f0d-43e4-ad54-448723da77e0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:21 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 Nov 02 11:53:21 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:21 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45" returned: 0 in 0.487s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f5b810-1c25-4de2-b80f-633542dbbd71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b6e7dd-1344-402e-a468-67d04fc8e3e1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:21 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 Nov 02 11:53:21 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:22 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71" returned: 0 in 0.468s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:53:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:53:22 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:53:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:22 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c Nov 02 11:53:22 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:30 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:53:30 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:53:31 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" returned: 0 in 9.602s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71, size 1024.00 MB, duration 9.60 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:53:31 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Converted 1024.00 MB image at 106.64 MB/s Nov 02 11:53:31 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c is being set with open permissions: ugo+rw Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:31 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c Nov 02 11:53:31 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:31 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" released by "_copy_volume_from_snapshot" :: held 10.941s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-53505d1d-6e15-4633-8429-b3ca2e780c45-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" released by "_create_volume_from_snapshot" :: held 11.018s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.036s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93ea720-fd62-416e-b288-d9f56f64eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c', 'volume_size': 1, 'snapshot_id': '53505d1d-6e15-4633-8429-b3ca2e780c45'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1d9751-7f3a-43a6-983f-949f19ebf4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Volume volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c (ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c): created successfully Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1d9751-7f3a-43a6-983f-949f19ebf4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Flow 'volume_create_manager' (a4e39a96-6f66-45dc-a266-216bc0eccb40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f8b2ef94-5502-4d21-a7f7-e883b813834b tempest-SnapshotDependencyTests-1149436391 None] Created volume successfully. Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-53505d1d-6e15-4633-8429-b3ca2e780c45-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-53505d1d-6e15-4633-8429-b3ca2e780c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-quobyte-a7f5b810-1c25-4de2-b80f-633542dbbd71" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-a7f5b810-1c25-4de2-b80f-633542dbbd71" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-quobyte-53505d1d-6e15-4633-8429-b3ca2e780c45" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-53505d1d-6e15-4633-8429-b3ca2e780c45" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Deleting offline snapshot 53505d1d-6e15-4633-8429-b3ca2e780c45 of volume a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] snapshot_file for this snap is: volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0442298-e1c4-4fa3-8504-7bae0b3fa540]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:32 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 Nov 02 11:53:32 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:32 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f5b810-1c25-4de2-b80f-633542dbbd71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d138f0a5-5b15-4d09-b7ec-4b47a8d7ddca]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:33 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 Nov 02 11:53:33 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:33 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71" returned: 0 in 0.755s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:33 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 Nov 02 11:53:33 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:34 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45" returned: 0 in 0.528s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:34 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45 Nov 02 11:53:34 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:34 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71.53505d1d-6e15-4633-8429-b3ca2e780c45" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-53505d1d-6e15-4633-8429-b3ca2e780c45" released by "_delete_snapshot" :: held 2.247s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-a7f5b810-1c25-4de2-b80f-633542dbbd71" released by "delete_snapshot" :: held 2.284s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Created reservations ['0c412357-120b-4060-a6cc-82f269d52265', '311fc2f4-944e-4ae7-a6d1-357dfca7fa3b', 'f6bae203-f8c9-4639-9ca5-eaa1e3fd7a14', 'fb9c9890-7131-40c2-b96f-ecdc78fc9b24'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:53:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Delete snapshot completed successfully. Nov 02 11:53:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57d51639-7e02-4ffd-b80f-17af7060a846 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-53505d1d-6e15-4633-8429-b3ca2e780c45-delete_snapshot" released by "delete_snapshot" :: held 2.469s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-a7f5b810-1c25-4de2-b80f-633542dbbd71-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-a7f5b810-1c25-4de2-b80f-633542dbbd71-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-quobyte-a7f5b810-1c25-4de2-b80f-633542dbbd71" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-a7f5b810-1c25-4de2-b80f-633542dbbd71" acquired by "delete_volume" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8bd44f-9dc2-4ee0-a1ec-a5ee1305a4fe]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:35 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 Nov 02 11:53:35 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:36 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:36 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71 Nov 02 11:53:36 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:36 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a7f5b810-1c25-4de2-b80f-633542dbbd71" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-a7f5b810-1c25-4de2-b80f-633542dbbd71" released by "delete_volume" :: held 0.857s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Created reservations ['c775f27a-5fff-49c3-8356-ba971aab44f2', '6a7b0a34-8b14-45ac-bc00-d4ea61ed83e1', '0db60e1c-5bab-43ac-99eb-6a3baafd5c66', '983ee296-15b4-4099-8e01-bb9c8657e555'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:36 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:53:36 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "cinder-quobyte-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0fdd7f-4caf-4480-aa5d-62e46b714aee]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:37 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.436s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:53:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Deleted volume successfully. Nov 02 11:53:37 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c Nov 02 11:53:37 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3ab2b1fd-9ab7-4135-9eab-76eec06b84c9 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-a7f5b810-1c25-4de2-b80f-633542dbbd71-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:37 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" returned: 0 in 0.648s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:37 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c Nov 02 11:53:37 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:38 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" returned: 0 in 0.289s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-quobyte-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c" released by "delete_volume" :: held 1.016s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Created reservations ['0a42d1dd-7572-48ca-8cef-5ac61a09fd51', '6b922e19-422e-44b5-8723-c38e4f4d2ba6', '5732e95e-460c-4ef1-889c-16f2d40ac5e5', '12412ea7-5d18-4d27-892d-a47b028b6196'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:38 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:53:38 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:53:38 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:53:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Deleted volume successfully. Nov 02 11:53:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b1f47228-501b-4d4f-ada1-2b3b3e9f9f25 tempest-SnapshotDependencyTests-1149436391 None] Lock "cinder-ef61aeae-1f18-4b3e-bb4b-953fcc7a7e4c-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:53:48 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=19,cinder:UPDATE=26,cinder:INSERT=7 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:53:48 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Flow 'volume_create_manager' (be06cd9f-cd49-4272-831e-acb960e8819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce2f235-c17f-4765-84f5-1c27857b9355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce2f235-c17f-4765-84f5-1c27857b9355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-321835643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639a7612-fe29-4841-bdd1-93bd441cae1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff127e4825a6496fa6c07660ee78d172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:53:59Z,use_quota=True,user_id='3c3e69223eec4c08971d9bcd60723d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(564b3df3-3ad5-4534-bcc9-dad64870bb90),volume_type_id=564b3df3-3ad5-4534-bcc9-dad64870bb90)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb56987-815c-427d-b911-4c726ccde31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb56987-815c-427d-b911-4c726ccde31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42df138-a687-4e8b-bef4-976884bcff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42df138-a687-4e8b-bef4-976884bcff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639a7612-fe29-4841-bdd1-93bd441cae1a', 'volume_name': 'volume-639a7612-fe29-4841-bdd1-93bd441cae1a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4403fcc6-1a81-448e-9da8-4022c91e06ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4403fcc6-1a81-448e-9da8-4022c91e06ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ece695-f4e3-403b-84f2-241cdf2a7987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:53:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume 639a7612-fe29-4841-bdd1-93bd441cae1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639a7612-fe29-4841-bdd1-93bd441cae1a', 'volume_size': 1} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-321835643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639a7612-fe29-4841-bdd1-93bd441cae1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff127e4825a6496fa6c07660ee78d172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:53:59Z,use_quota=True,user_id='3c3e69223eec4c08971d9bcd60723d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(564b3df3-3ad5-4534-bcc9-dad64870bb90),volume_type_id=564b3df3-3ad5-4534-bcc9-dad64870bb90)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Creating volume 639a7612-fe29-4841-bdd1-93bd441cae1a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:53:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:53:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:53:59 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a 1073741824 Nov 02 11:53:59 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Flow 'volume_create_manager' (b5182f97-14ea-445c-9656-468ad800ec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b644781-c0c4-47f7-975e-f016ed8514ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b644781-c0c4-47f7-975e-f016ed8514ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-734545489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b2879c-b8ea-40c4-ab62-073f71e1b891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff127e4825a6496fa6c07660ee78d172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:54:00Z,use_quota=True,user_id='3c3e69223eec4c08971d9bcd60723d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e3e71a3-f88b-4c63-9614-08c1c21ea372),volume_type_id=9e3e71a3-f88b-4c63-9614-08c1c21ea372)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47232fb0-fcfc-46c5-982f-64971664a649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47232fb0-fcfc-46c5-982f-64971664a649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c94e873-44f3-4ba0-8f27-3a3a23bac501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c94e873-44f3-4ba0-8f27-3a3a23bac501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b2879c-b8ea-40c4-ab62-073f71e1b891', 'volume_name': 'volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7755aa70-4504-42be-9c70-2fe9d9ebf42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7755aa70-4504-42be-9c70-2fe9d9ebf42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d50620-314c-4392-8821-3d64528e92af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume b6b2879c-b8ea-40c4-ab62-073f71e1b891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891', 'volume_size': 1} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:00 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a 1073741824" returned: 0 in 1.095s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:00 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a Nov 02 11:54:00 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:01 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a" returned: 0 in 0.417s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-734545489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b2879c-b8ea-40c4-ab62-073f71e1b891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff127e4825a6496fa6c07660ee78d172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:54:00Z,use_quota=True,user_id='3c3e69223eec4c08971d9bcd60723d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e3e71a3-f88b-4c63-9614-08c1c21ea372),volume_type_id=9e3e71a3-f88b-4c63-9614-08c1c21ea372)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Creating volume b6b2879c-b8ea-40c4-ab62-073f71e1b891 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:54:01 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ece695-f4e3-403b-84f2-241cdf2a7987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639a7612-fe29-4841-bdd1-93bd441cae1a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:01 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 1073741824 Nov 02 11:54:01 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdde418-b752-48dd-b991-c91db4006ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume volume-639a7612-fe29-4841-bdd1-93bd441cae1a (639a7612-fe29-4841-bdd1-93bd441cae1a): created successfully Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdde418-b752-48dd-b991-c91db4006ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Flow 'volume_create_manager' (be06cd9f-cd49-4272-831e-acb960e8819c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:54:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-90e8141a-b2a6-4e4c-b4e8-ab1a53f934d3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Created volume successfully. Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Flow 'volume_create_manager' (d36893f6-3304-45c6-9d6d-1b995c49d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58947357-4afe-4dd2-8eaa-57d142157025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58947357-4afe-4dd2-8eaa-57d142157025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-410690903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959258cd-1c5f-43a9-b2d4-56ddac8cc675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff127e4825a6496fa6c07660ee78d172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:54:02Z,use_quota=True,user_id='3c3e69223eec4c08971d9bcd60723d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94756e83-ee91-49a9-a959-6ab2ec8c5046),volume_type_id=94756e83-ee91-49a9-a959-6ab2ec8c5046)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95affeb-5637-4ea0-8538-cac5aef5f6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95affeb-5637-4ea0-8538-cac5aef5f6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017b1772-ea41-45ad-b93c-8bda4d376031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:54:01 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 1073741824" returned: 0 in 0.813s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:02 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 Nov 02 11:54:02 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017b1772-ea41-45ad-b93c-8bda4d376031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '959258cd-1c5f-43a9-b2d4-56ddac8cc675', 'volume_name': 'volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675', 'volume_size': 1, 'image_id': '3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1675331555', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff127e4825a6496fa6c07660ee78d172', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'created_at': datetime.datetime(2026, 11, 2, 10, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470a077a-7298-49eb-9977-c27f4975381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470a077a-7298-49eb-9977-c27f4975381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4417d4ee-2539-4541-aca9-bacc29b45368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume 959258cd-1c5f-43a9-b2d4-56ddac8cc675: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675', 'volume_size': 1, 'image_id': '3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1675331555', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff127e4825a6496fa6c07660ee78d172', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'created_at': datetime.datetime(2026, 11, 2, 10, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5/file', 'properties': {}}, 'image_service': } Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Trying to clone 959258cd-1c5f-43a9-b2d4-56ddac8cc675 from image 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:54:02 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d50620-314c-4392-8821-3d64528e92af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d68b5d6-92bd-4c24-bdd0-f527d6b96c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 (b6b2879c-b8ea-40c4-ab62-073f71e1b891): created successfully Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d68b5d6-92bd-4c24-bdd0-f527d6b96c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Flow 'volume_create_manager' (b5182f97-14ea-445c-9656-468ad800ec21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:54:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-41f375b6-c4ba-4438-b78b-0b30e3f9eeb3 tempest-TestInstancesWithCinderVolumes-1597841481 None] Created volume successfully. Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Flow 'volume_create_manager' (99360a6e-d9d2-46be-bfb5-85b899d0aafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532e33c5-ba7b-4659-9fa7-bef2a83e9147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532e33c5-ba7b-4659-9fa7-bef2a83e9147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1557528227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1686a030-a163-4a5c-a7cf-0cf76109c959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbf72b3dfff457ebfa387b016127cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:54:04Z,use_quota=True,user_id='bd4599c5a094421c8e28c47c3793cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9ca3c2-7993-421f-9c95-72b65e95f1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9ca3c2-7993-421f-9c95-72b65e95f1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3ed8f6-b386-4c6d-a911-d8b9eed6917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3ed8f6-b386-4c6d-a911-d8b9eed6917d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1686a030-a163-4a5c-a7cf-0cf76109c959', 'volume_name': 'volume-1686a030-a163-4a5c-a7cf-0cf76109c959', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbef81f-2a7c-48df-890b-a40409a2965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbef81f-2a7c-48df-890b-a40409a2965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6bdfb6-6a96-4f91-a3d8-aeeab07f31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Volume 1686a030-a163-4a5c-a7cf-0cf76109c959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1686a030-a163-4a5c-a7cf-0cf76109c959', 'volume_size': 1} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1557528227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1686a030-a163-4a5c-a7cf-0cf76109c959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbf72b3dfff457ebfa387b016127cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:54:04Z,use_quota=True,user_id='bd4599c5a094421c8e28c47c3793cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Creating volume 1686a030-a163-4a5c-a7cf-0cf76109c959 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:54:04 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:04 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 1073741824 Nov 02 11:54:04 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:04 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 1073741824" returned: 0 in 0.592s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:05 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 Nov 02 11:54:05 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:05 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959" returned: 0 in 0.379s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:54:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6bdfb6-6a96-4f91-a3d8-aeeab07f31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1686a030-a163-4a5c-a7cf-0cf76109c959', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2395ac53-2da8-4133-be5b-6e727702ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Volume volume-1686a030-a163-4a5c-a7cf-0cf76109c959 (1686a030-a163-4a5c-a7cf-0cf76109c959): created successfully Nov 02 11:54:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2395ac53-2da8-4133-be5b-6e727702ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Flow 'volume_create_manager' (99360a6e-d9d2-46be-bfb5-85b899d0aafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:54:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-48eb6de7-3d9a-4ab2-bdbc-25c34076a19a tempest-TestMinimumBasicScenario-688572489 None] Created volume successfully. Nov 02 11:54:06 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD, size 20.69 MB, duration 4.20 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:54:06 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Image download 20.69 MB at 4.93 MB/s Nov 02 11:54:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a0a0a8-e7fb-4afc-b41b-3ca3acd287ba]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:54:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:06 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD Nov 02 11:54:06 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:07 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Temporary image 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 is fetched for user 3c3e69223eec4c08971d9bcd60723d82. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b24a97-56ed-4b27-bb33-184bc78a48a9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:07 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD Nov 02 11:54:07 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Acquiring lock "cinder-8d6bf150-ad25-47f5-a059-5700fc0b4046-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Lock "cinder-8d6bf150-ad25-47f5-a059-5700fc0b4046-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Acquiring lock "cinder-quobyte-8d6bf150-ad25-47f5-a059-5700fc0b4046" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Lock "cinder-quobyte-8d6bf150-ad25-47f5-a059-5700fc0b4046" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[878006f0-c5c8-4ec7-8e2a-518b5223eeba]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:54:07 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-410690903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959258cd-1c5f-43a9-b2d4-56ddac8cc675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff127e4825a6496fa6c07660ee78d172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:54:02Z,use_quota=True,user_id='3c3e69223eec4c08971d9bcd60723d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94756e83-ee91-49a9-a959-6ab2ec8c5046),volume_type_id=94756e83-ee91-49a9-a959-6ab2ec8c5046)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Creating volume 959258cd-1c5f-43a9-b2d4-56ddac8cc675 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:54:07 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:54:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:07 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 1073741824 Nov 02 11:54:07 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:08 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 Nov 02 11:54:08 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-984ca168-47e0-4f51-af1f-d4e1b53cd741 req-8b5a56c1-3eae-4def-a525-f5f096d92767 tempest-TestMinimumBasicScenario-688572489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:08 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:08 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046 Nov 02 11:54:08 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:08 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 1073741824" returned: 0 in 0.586s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:08 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8d6bf150-ad25-47f5-a059-5700fc0b4046" returned: 0 in 0.297s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:08 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 Nov 02 11:54:08 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Lock "cinder-quobyte-8d6bf150-ad25-47f5-a059-5700fc0b4046" released by "delete_volume" :: held 0.785s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Created reservations ['f2be6602-e411-4c89-b7ee-8a0cd7c2f493', '458b56e6-1627-44fd-8149-5bf121d8d19e', '523921c2-468d-4704-9078-300665bf3bf0', 'dd269d9e-5056-4837-8d30-4ee18be3a63e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:08 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:54:08 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:08 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-984ca168-47e0-4f51-af1f-d4e1b53cd741 req-8b5a56c1-3eae-4def-a525-f5f096d92767 tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.623s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-984ca168-47e0-4f51-af1f-d4e1b53cd741 req-8b5a56c1-3eae-4def-a525-f5f096d92767 tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Attempting download of 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'metadata': {}}])) to volume 959258cd-1c5f-43a9-b2d4-56ddac8cc675. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:54:08 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-984ca168-47e0-4f51-af1f-d4e1b53cd741 req-8b5a56c1-3eae-4def-a525-f5f096d92767 tempest-TestMinimumBasicScenario-688572489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-1686a030-a163-4a5c-a7cf-0cf76109c959', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b6f4a23-7d53-4eab-b02f-2e1143cbeedf', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:54:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[24272eea-d249-45f8-802e-edff5f7a790c]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:54:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_pmph2z_n {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:09 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.388s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:09 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:54:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-984ca168-47e0-4f51-af1f-d4e1b53cd741 req-8b5a56c1-3eae-4def-a525-f5f096d92767 tempest-TestMinimumBasicScenario-688572489 None] attachment_update completed successfully. Nov 02 11:54:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Deleted volume successfully. Nov 02 11:54:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-26f4aa2b-231d-4cf3-8407-ea5b33ace8ad tempest-VolumesNegativeTest-1686561718 None] Lock "cinder-8d6bf150-ad25-47f5-a059-5700fc0b4046-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:54:09 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_pmph2z_n Nov 02 11:54:09 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:09 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_pmph2z_n" returned: 0 in 0.487s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_pmph2z_n {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:09 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_pmph2z_n Nov 02 11:54:09 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:10 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_pmph2z_n" returned: 1 in 0.516s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_pmph2z_n' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:54:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee65ac9-3b14-4e42-9b8c-561c824f3a76]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:54:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:10 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD Nov 02 11:54:10 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:10 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:10 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:54:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:10 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 Nov 02 11:54:10 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:12 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675" returned: 0 in 2.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:12 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3bb8a18d-96b8-462f-a30d-6f67b35da1b5_g_fq0p62devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:54:12 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Converted 112.00 MB image at 48.82 MB/s Nov 02 11:54:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:12 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 1G Nov 02 11:54:12 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:13 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 1G" returned: 0 in 0.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Downloaded image 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'metadata': {}}])) to volume 959258cd-1c5f-43a9-b2d4-56ddac8cc675 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Temporary image 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 for user 3c3e69223eec4c08971d9bcd60723d82 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Marking volume 959258cd-1c5f-43a9-b2d4-56ddac8cc675 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Copying metadata from image 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 to 959258cd-1c5f-43a9-b2d4-56ddac8cc675. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Creating volume glance metadata for volume 959258cd-1c5f-43a9-b2d4-56ddac8cc675 backed by image 3bb8a18d-96b8-462f-a30d-6f67b35da1b5 with: {'image_id': '3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'image_name': 'tempest-scenario-img--1675331555', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4417d4ee-2539-4541-aca9-bacc29b45368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675', 'volume_size': 1, 'image_id': '3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1675331555', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff127e4825a6496fa6c07660ee78d172', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3bb8a18d-96b8-462f-a30d-6f67b35da1b5', 'created_at': datetime.datetime(2026, 11, 2, 10, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bb8a18d-96b8-462f-a30d-6f67b35da1b5/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987364f9-0d2b-4355-a79c-75e6a03f4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:54:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Volume volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 (959258cd-1c5f-43a9-b2d4-56ddac8cc675): created successfully Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987364f9-0d2b-4355-a79c-75e6a03f4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:54:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Flow 'volume_create_manager' (d36893f6-3304-45c6-9d6d-1b995c49d08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:54:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ecb06106-0365-407c-9cfb-84ec116696c1 tempest-TestInstancesWithCinderVolumes-1597841481 None] Created volume successfully. Nov 02 11:54:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:54:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:54:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:54:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:54:19 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:54:19 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:54:19 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7fa4e74b-3790-4d38-9f8d-2526e1fff908 req-4005998b-4bcd-4ca8-8cf7-3e01bc95cb43 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7fa4e74b-3790-4d38-9f8d-2526e1fff908 req-4005998b-4bcd-4ca8-8cf7-3e01bc95cb43 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:54:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7fa4e74b-3790-4d38-9f8d-2526e1fff908 req-4005998b-4bcd-4ca8-8cf7-3e01bc95cb43 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.094s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:54:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-7fa4e74b-3790-4d38-9f8d-2526e1fff908 req-4005998b-4bcd-4ca8-8cf7-3e01bc95cb43 tempest-TestInstancesWithCinderVolumes-1597841481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cde44ef-a033-457c-8777-4655a1968f78', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:54:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-7fa4e74b-3790-4d38-9f8d-2526e1fff908 req-4005998b-4bcd-4ca8-8cf7-3e01bc95cb43 tempest-TestInstancesWithCinderVolumes-1597841481 None] attachment_update completed successfully. Nov 02 11:54:30 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:54:30 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=36,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:55:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-9b10c4c7-ad7a-49a6-bdc0-77f797d8d108 req-07670032-0d01-4c19-a3b8-a60afe7912c6 tempest-TestMinimumBasicScenario-688572489 None] Terminate volume connection completed successfully. Nov 02 11:55:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-9b10c4c7-ad7a-49a6-bdc0-77f797d8d108 req-07670032-0d01-4c19-a3b8-a60afe7912c6 tempest-TestMinimumBasicScenario-688572489 None] Deleting attachment 4b6f4a23-7d53-4eab-b02f-2e1143cbeedf. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Acquiring lock "cinder-1686a030-a163-4a5c-a7cf-0cf76109c959-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Lock "cinder-1686a030-a163-4a5c-a7cf-0cf76109c959-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Acquiring lock "cinder-quobyte-1686a030-a163-4a5c-a7cf-0cf76109c959" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Lock "cinder-quobyte-1686a030-a163-4a5c-a7cf-0cf76109c959" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f4afb9-9413-4ef7-8be5-c75178f4e6b7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:03 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 Nov 02 11:55:03 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:03 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:03 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959 Nov 02 11:55:03 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:03 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1686a030-a163-4a5c-a7cf-0cf76109c959" returned: 0 in 0.268s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Lock "cinder-quobyte-1686a030-a163-4a5c-a7cf-0cf76109c959" released by "delete_volume" :: held 0.708s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Created reservations ['a59ba864-926b-4eb0-a7fc-de98ccb55ad9', 'a7b85700-63e1-4fee-b1ba-2c570ba2433c', '0ece6ced-caef-4718-aac0-4df9ee3aab32', '744adfd0-fe11-4a5f-b3e0-a0a0f3a78f7b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:04 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:55:04 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:04 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.261s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:04 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:55:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Deleted volume successfully. Nov 02 11:55:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0a8006ad-e0e8-49f0-a104-afe24e37bd66 tempest-TestMinimumBasicScenario-688572489 None] Lock "cinder-1686a030-a163-4a5c-a7cf-0cf76109c959-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-862d726e-9823-49c0-a9c6-1ce889f060d2 req-c3ce4a51-a54e-4361-9a56-c7bcaf91eac9 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-862d726e-9823-49c0-a9c6-1ce889f060d2 req-c3ce4a51-a54e-4361-9a56-c7bcaf91eac9 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-862d726e-9823-49c0-a9c6-1ce889f060d2 req-c3ce4a51-a54e-4361-9a56-c7bcaf91eac9 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-862d726e-9823-49c0-a9c6-1ce889f060d2 req-c3ce4a51-a54e-4361-9a56-c7bcaf91eac9 tempest-TestInstancesWithCinderVolumes-1597841481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-639a7612-fe29-4841-bdd1-93bd441cae1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cde1360-903c-412d-8e77-4d3e05f3d281', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:55:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-862d726e-9823-49c0-a9c6-1ce889f060d2 req-c3ce4a51-a54e-4361-9a56-c7bcaf91eac9 tempest-TestInstancesWithCinderVolumes-1597841481 None] attachment_update completed successfully. Nov 02 11:55:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-38a449ae-b4fa-4125-8eba-5255f76b9e16 req-069c2737-b0dd-4180-ba2f-2b96c75f4252 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-38a449ae-b4fa-4125-8eba-5255f76b9e16 req-069c2737-b0dd-4180-ba2f-2b96c75f4252 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-38a449ae-b4fa-4125-8eba-5255f76b9e16 req-069c2737-b0dd-4180-ba2f-2b96c75f4252 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-38a449ae-b4fa-4125-8eba-5255f76b9e16 req-069c2737-b0dd-4180-ba2f-2b96c75f4252 tempest-TestInstancesWithCinderVolumes-1597841481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e820313d-3483-4695-a4f6-ac530159ec2b', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:55:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-38a449ae-b4fa-4125-8eba-5255f76b9e16 req-069c2737-b0dd-4180-ba2f-2b96c75f4252 tempest-TestInstancesWithCinderVolumes-1597841481 None] attachment_update completed successfully. Nov 02 11:55:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-7f2300bc-c8fa-4585-9098-5087ea90cd41 req-819b9bc3-c63f-4f06-9b1f-330f7f211b1e tempest-TestInstancesWithCinderVolumes-1597841481 None] Terminate volume connection completed successfully. Nov 02 11:55:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-7f2300bc-c8fa-4585-9098-5087ea90cd41 req-819b9bc3-c63f-4f06-9b1f-330f7f211b1e tempest-TestInstancesWithCinderVolumes-1597841481 None] Deleting attachment 3cde1360-903c-412d-8e77-4d3e05f3d281. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "cinder-639a7612-fe29-4841-bdd1-93bd441cae1a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-639a7612-fe29-4841-bdd1-93bd441cae1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "cinder-quobyte-639a7612-fe29-4841-bdd1-93bd441cae1a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-quobyte-639a7612-fe29-4841-bdd1-93bd441cae1a" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14a771-4c7c-4c30-9a82-30b3f2767126]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:13 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a Nov 02 11:55:13 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Flow 'volume_create_manager' (ba84c6c9-7ad6-47c4-b8e2-3e4ffc89bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4729261-4d8a-4fbe-98f2-7f8d20f9f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4729261-4d8a-4fbe-98f2-7f8d20f9f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1544316737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9273b94a-1db0-4b2e-b64c-70e9228b53e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255c27cee9ec4b8cac7196e757b99e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:55:14Z,use_quota=True,user_id='5edb65520d8e4836b5e0a52d86145712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:13 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bd812a-e65a-4eca-a09e-b9010a79edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bd812a-e65a-4eca-a09e-b9010a79edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9decdbf0-eeea-4703-b2c8-9824bf76fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9decdbf0-eeea-4703-b2c8-9824bf76fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9273b94a-1db0-4b2e-b64c-70e9228b53e1', 'volume_name': 'volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8733e9b3-c467-4aaa-88d2-2865816e0ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8733e9b3-c467-4aaa-88d2-2865816e0ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79f0061-eac2-4695-b2a2-43790c9619a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Volume 9273b94a-1db0-4b2e-b64c-70e9228b53e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1', 'volume_size': 1} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1544316737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9273b94a-1db0-4b2e-b64c-70e9228b53e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255c27cee9ec4b8cac7196e757b99e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:55:14Z,use_quota=True,user_id='5edb65520d8e4836b5e0a52d86145712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Creating volume 9273b94a-1db0-4b2e-b64c-70e9228b53e1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:55:14 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a" returned: 0 in 0.591s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:14 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 1073741824 Nov 02 11:55:14 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:14 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a Nov 02 11:55:14 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:14 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-639a7612-fe29-4841-bdd1-93bd441cae1a" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-quobyte-639a7612-fe29-4841-bdd1-93bd441cae1a" released by "delete_volume" :: held 1.016s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:14 devstack cinder-volume[86846]: WARNING cinder.quota [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667492409-1104550379 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667492409-1104550379, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:55:14 devstack cinder-volume[86846]: WARNING cinder.quota [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667492409-1104550379 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667492409-1104550379, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Created reservations ['c1222934-2c92-40a3-8b72-5c644c696d44', '782b9dab-a90e-493a-a457-9006422b9d03', 'f9978501-0ab4-4f62-a45a-6aa389e2a04f', '45e69de6-4f3d-44b7-9f48-a415820b98db'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:14 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:55:14 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:14 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 1073741824" returned: 0 in 0.654s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:14 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 Nov 02 11:55:14 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:14 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:55:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Deleted volume successfully. Nov 02 11:55:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e2910c63-deaf-430c-a2aa-fc9994ca28ee tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-639a7612-fe29-4841-bdd1-93bd441cae1a-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:15 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:55:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79f0061-eac2-4695-b2a2-43790c9619a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9168acc8-ffc1-416b-897c-44baa9cf2d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Volume volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 (9273b94a-1db0-4b2e-b64c-70e9228b53e1): created successfully Nov 02 11:55:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9168acc8-ffc1-416b-897c-44baa9cf2d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Flow 'volume_create_manager' (ba84c6c9-7ad6-47c4-b8e2-3e4ffc89bff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:55:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1e4ecab5-8d06-4053-8a3d-e13b006f9a04 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Created volume successfully. Nov 02 11:55:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-28e2007b-2c6e-4f4e-92d6-45b88846ce2a req-c54b4d34-c48b-4a5a-b07f-8e50e65947e1 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-28e2007b-2c6e-4f4e-92d6-45b88846ce2a req-c54b4d34-c48b-4a5a-b07f-8e50e65947e1 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-28e2007b-2c6e-4f4e-92d6-45b88846ce2a req-c54b4d34-c48b-4a5a-b07f-8e50e65947e1 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-28e2007b-2c6e-4f4e-92d6-45b88846ce2a req-c54b4d34-c48b-4a5a-b07f-8e50e65947e1 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c3d0b6d-d534-4417-b7ed-b9243e18441a', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:55:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-28e2007b-2c6e-4f4e-92d6-45b88846ce2a req-c54b4d34-c48b-4a5a-b07f-8e50e65947e1 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] attachment_update completed successfully. Nov 02 11:55:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-b009a68e-c33f-487e-b772-f28da81df128 req-3b4961c1-2c9b-4705-a76b-f3ae1e94f64d tempest-TestInstancesWithCinderVolumes-1597841481 None] Terminate volume connection completed successfully. Nov 02 11:55:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-b009a68e-c33f-487e-b772-f28da81df128 req-3b4961c1-2c9b-4705-a76b-f3ae1e94f64d tempest-TestInstancesWithCinderVolumes-1597841481 None] Deleting attachment e820313d-3483-4695-a4f6-ac530159ec2b. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "cinder-b6b2879c-b8ea-40c4-ab62-073f71e1b891-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-b6b2879c-b8ea-40c4-ab62-073f71e1b891-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "cinder-quobyte-b6b2879c-b8ea-40c4-ab62-073f71e1b891" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-quobyte-b6b2879c-b8ea-40c4-ab62-073f71e1b891" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a0ba3f-a8a0-4905-9278-34f3a854058e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:18 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 Nov 02 11:55:18 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:18 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:55:19 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:19 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891" returned: 0 in 0.671s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:19 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:55:19 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891 Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:55:19 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:19 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b6b2879c-b8ea-40c4-ab62-073f71e1b891" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-quobyte-b6b2879c-b8ea-40c4-ab62-073f71e1b891" released by "delete_volume" :: held 1.093s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:19 devstack cinder-volume[86846]: WARNING cinder.quota [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1524387855-1511647981 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1524387855-1511647981, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:55:19 devstack cinder-volume[86846]: WARNING cinder.quota [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1524387855-1511647981 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1524387855-1511647981, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Created reservations ['df5800ec-a13e-4d9b-9083-9a0cae4571d3', 'b0f1a607-48e4-4e85-94c3-0517334bd926', '06ac7ffc-fae9-4fef-9cab-8d4bd2854068', '9eb31850-9454-4e84-8aa0-ea23b5b35b59'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:19 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:55:19 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:20 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:20 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:55:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Deleted volume successfully. Nov 02 11:55:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-612d648a-7071-46ae-8aa6-94249c56960c tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-b6b2879c-b8ea-40c4-ab62-073f71e1b891-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-58e35bc6-5719-45f7-8b93-791eca167d30 req-e49b6bc5-08f5-46c7-8897-795a4d917735 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Terminate volume connection completed successfully. Nov 02 11:55:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-58e35bc6-5719-45f7-8b93-791eca167d30 req-e49b6bc5-08f5-46c7-8897-795a4d917735 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Deleting attachment 7c3d0b6d-d534-4417-b7ed-b9243e18441a. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Acquiring lock "cinder-9273b94a-1db0-4b2e-b64c-70e9228b53e1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "cinder-9273b94a-1db0-4b2e-b64c-70e9228b53e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Acquiring lock "cinder-quobyte-9273b94a-1db0-4b2e-b64c-70e9228b53e1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "cinder-quobyte-9273b94a-1db0-4b2e-b64c-70e9228b53e1" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcfe1e4-8775-4bc6-8047-821a769e6a78]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:21 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 Nov 02 11:55:21 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:21 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1" returned: 0 in 0.450s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:21 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1 Nov 02 11:55:21 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:22 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9273b94a-1db0-4b2e-b64c-70e9228b53e1" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "cinder-quobyte-9273b94a-1db0-4b2e-b64c-70e9228b53e1" released by "delete_volume" :: held 0.821s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Created reservations ['8a9aa680-518f-4ffc-a2b1-3be820ba103c', 'fc3e40dc-1c8f-4f0e-bccd-4f41bee51dc0', '19810b71-7b1d-44ea-a135-65c2b966332e', 'ae9543b9-4d13-4c79-9dbc-f03f1deea373'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:22 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:55:22 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:22 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.668s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:55:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Deleted volume successfully. Nov 02 11:55:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b7880876-694a-4d90-b0b9-ed92f052e880 tempest-TestServerVolumeAttachScenarioOldVersion-1402598833 None] Lock "cinder-9273b94a-1db0-4b2e-b64c-70e9228b53e1-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-c7dedc82-897a-49b0-968d-3484675242c5 req-9be90684-1e09-4118-b894-eaa3324a8980 tempest-TestInstancesWithCinderVolumes-1597841481 None] Terminate volume connection completed successfully. Nov 02 11:55:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-c7dedc82-897a-49b0-968d-3484675242c5 req-9be90684-1e09-4118-b894-eaa3324a8980 tempest-TestInstancesWithCinderVolumes-1597841481 None] Deleting attachment 5cde44ef-a033-457c-8777-4655a1968f78. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "cinder-959258cd-1c5f-43a9-b2d4-56ddac8cc675-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-959258cd-1c5f-43a9-b2d4-56ddac8cc675-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "cinder-quobyte-959258cd-1c5f-43a9-b2d4-56ddac8cc675" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-quobyte-959258cd-1c5f-43a9-b2d4-56ddac8cc675" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bda1bc-2004-4942-87ea-6f5a4489f624]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:25 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 Nov 02 11:55:25 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:25 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675" returned: 0 in 0.385s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:25 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675 Nov 02 11:55:25 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:25 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-959258cd-1c5f-43a9-b2d4-56ddac8cc675" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-quobyte-959258cd-1c5f-43a9-b2d4-56ddac8cc675" released by "delete_volume" :: held 0.713s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:25 devstack cinder-volume[86846]: WARNING cinder.quota [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1564110656-573680826 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1564110656-573680826, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:55:25 devstack cinder-volume[86846]: WARNING cinder.quota [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1564110656-573680826 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1564110656-573680826, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Created reservations ['87758f40-5163-4876-a788-bae7659ad4cf', '8062ec9a-1481-42a7-9e00-99dcec8eb355', '15ed517b-4b77-4d3c-892d-60067131f9cd', '6edf36c5-377b-4103-ba9a-03ea7051f8da'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:26 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:55:26 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:26 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.414s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:55:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Deleted volume successfully. Nov 02 11:55:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-794a4d7d-d16e-4ef1-b980-0ace098b47e2 tempest-TestInstancesWithCinderVolumes-1597841481 None] Lock "cinder-959258cd-1c5f-43a9-b2d4-56ddac8cc675-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:55:36 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=49,cinder:UPDATE=46,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:55:36 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=54,cinder:INSERT=12,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Flow 'volume_create_manager' (a0d6e29c-7cab-444e-8644-a3488eb82bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7069e7-2461-432c-84c1-ce76e294b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7069e7-2461-432c-84c1-ce76e294b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1960336991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1ab64e-2fd7-424c-8708-b5919ce2c8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8a49650ed44b45bd994df26e304179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:55:47Z,use_quota=True,user_id='84d146d58eda43909bc378863206995a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6b6021-422b-431d-92dc-86c5b385664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6b6021-422b-431d-92dc-86c5b385664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ab905c-fdfe-4906-b808-65da7cb70f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ab905c-fdfe-4906-b808-65da7cb70f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1ab64e-2fd7-424c-8708-b5919ce2c8c9', 'volume_name': 'volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c12681-a569-43f6-8daa-f99de125002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c12681-a569-43f6-8daa-f99de125002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ebe0b3-405d-45ff-a6d4-2ee3a4704aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Volume 4b1ab64e-2fd7-424c-8708-b5919ce2c8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9', 'volume_size': 1} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1960336991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1ab64e-2fd7-424c-8708-b5919ce2c8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8a49650ed44b45bd994df26e304179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:55:47Z,use_quota=True,user_id='84d146d58eda43909bc378863206995a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Creating volume 4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:55:47 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:55:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:47 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 1073741824 Nov 02 11:55:47 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Flow 'volume_create_manager' (c99c671f-1091-40e4-b3d1-bd473c41fbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45570eeb-0a78-4bd3-8325-0d71f926528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45570eeb-0a78-4bd3-8325-0d71f926528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-695082421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e540cd2-7d68-4a16-8bc3-8056fdab123d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8a49650ed44b45bd994df26e304179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:55:48Z,use_quota=True,user_id='84d146d58eda43909bc378863206995a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dfaf92-e99e-49d8-b5d2-f4b630e24519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dfaf92-e99e-49d8-b5d2-f4b630e24519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fcd399-4fd8-45d5-a70c-d6af4193d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fcd399-4fd8-45d5-a70c-d6af4193d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e540cd2-7d68-4a16-8bc3-8056fdab123d', 'volume_name': 'volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce04e460-1a9a-4571-863d-c91de74b16ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce04e460-1a9a-4571-863d-c91de74b16ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8def0f8-d68f-4171-a6a4-5f4e8bf6570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Volume 2e540cd2-7d68-4a16-8bc3-8056fdab123d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d', 'volume_size': 1} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:48 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 1073741824" returned: 0 in 0.723s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:48 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 Nov 02 11:55:48 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:48 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9" returned: 0 in 0.333s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-695082421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e540cd2-7d68-4a16-8bc3-8056fdab123d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8a49650ed44b45bd994df26e304179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:55:48Z,use_quota=True,user_id='84d146d58eda43909bc378863206995a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Creating volume 2e540cd2-7d68-4a16-8bc3-8056fdab123d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:55:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:48 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d 1073741824 Nov 02 11:55:48 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ebe0b3-405d-45ff-a6d4-2ee3a4704aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269e4183-a654-48bf-9e91-d1ac18ce9109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Volume volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 (4b1ab64e-2fd7-424c-8708-b5919ce2c8c9): created successfully Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269e4183-a654-48bf-9e91-d1ac18ce9109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Flow 'volume_create_manager' (a0d6e29c-7cab-444e-8644-a3488eb82bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:55:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6c08e138-8c60-4367-999e-d5a13b909356 tempest-TestServerVolumeAttachmentScenario-235950642 None] Created volume successfully. Nov 02 11:55:49 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d 1073741824" returned: 0 in 0.601s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:55:49 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d Nov 02 11:55:49 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:55:49 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8def0f8-d68f-4171-a6a4-5f4e8bf6570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c140f74f-bd3f-41b5-a2b8-11876cdb50d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:55:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Volume volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d (2e540cd2-7d68-4a16-8bc3-8056fdab123d): created successfully Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c140f74f-bd3f-41b5-a2b8-11876cdb50d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:55:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Flow 'volume_create_manager' (c99c671f-1091-40e4-b3d1-bd473c41fbda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:55:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1118280a-e3b4-4686-b051-200c6a4b05f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Created volume successfully. Nov 02 11:55:59 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:55:59 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Flow 'volume_create_manager' (be91f43f-52a8-484b-8af1-ccc28c84407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b123e28-52a2-4ad9-be3a-a01505893a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b123e28-52a2-4ad9-be3a-a01505893a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1550613965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a436b6f2-517b-4f68-863c-1aa8f2babb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358a977b7fc74f28acc448beb1e622aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:56:12Z,use_quota=True,user_id='6d1ac20b51bb45a0aad3559b7fc5932f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3acdaed-9fa1-4e18-b91e-7a7748e5bf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3acdaed-9fa1-4e18-b91e-7a7748e5bf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dfda07-ec20-49de-b4e5-ad2d266abe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dfda07-ec20-49de-b4e5-ad2d266abe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a436b6f2-517b-4f68-863c-1aa8f2babb7d', 'volume_name': 'volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de28110-b860-4467-89d0-149689f76b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de28110-b860-4467-89d0-149689f76b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce28cde6-6fbe-4288-a537-d8ca839b74ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Volume a436b6f2-517b-4f68-863c-1aa8f2babb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d', 'volume_size': 1} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1550613965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a436b6f2-517b-4f68-863c-1aa8f2babb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358a977b7fc74f28acc448beb1e622aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:56:12Z,use_quota=True,user_id='6d1ac20b51bb45a0aad3559b7fc5932f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Creating volume a436b6f2-517b-4f68-863c-1aa8f2babb7d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:56:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:56:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:12 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d 1073741824 Nov 02 11:56:12 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:13 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d 1073741824" returned: 0 in 0.797s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:13 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d Nov 02 11:56:13 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:13 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce28cde6-6fbe-4288-a537-d8ca839b74ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309f3aa8-1144-4025-801d-db501878803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Volume volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d (a436b6f2-517b-4f68-863c-1aa8f2babb7d): created successfully Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309f3aa8-1144-4025-801d-db501878803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Flow 'volume_create_manager' (be91f43f-52a8-484b-8af1-ccc28c84407a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:56:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-457a6613-1ca0-44be-aa1d-d09a6bd2ca5e tempest-TestImageHashVerification-156903059 None] Created volume successfully. Nov 02 11:56:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07a125c-592e-4d2d-afd8-f4120d8c7f11]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:16 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d Nov 02 11:56:16 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:16 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d" returned: 0 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13902db-dff1-4d55-9eb8-8740256467c0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:16 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d Nov 02 11:56:16 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:17 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d" returned: 0 in 0.506s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d /opt/stack/data/cinder/conversion/a436b6f2-517b-4f68-863c-1aa8f2babb7d.temp_image.f5f8854e-c1ad-469a-8ba9-8174f6e869eefc_pabgw.img {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:17 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d /opt/stack/data/cinder/conversion/a436b6f2-517b-4f68-863c-1aa8f2babb7d.temp_image.f5f8854e-c1ad-469a-8ba9-8174f6e869eefc_pabgw.img Nov 02 11:56:17 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:56:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:56:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:56:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:19 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:56:19 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:19 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.749s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:56:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:56:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:56:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:56:26 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d /opt/stack/data/cinder/conversion/a436b6f2-517b-4f68-863c-1aa8f2babb7d.temp_image.f5f8854e-c1ad-469a-8ba9-8174f6e869eefc_pabgw.img" returned: 0 in 9.011s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a3baac-358f-4a62-9258-b88b03368eea]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:26 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d Nov 02 11:56:26 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:26 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d" returned: 0 in 0.623s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:26 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/conversion/a436b6f2-517b-4f68-863c-1aa8f2babb7d.temp_image.f5f8854e-c1ad-469a-8ba9-8174f6e869eefc_pabgw.img {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:56:26 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Converted 1024.00 MB image at 113.63 MB/s Nov 02 11:56:26 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] f5f8854e-c1ad-469a-8ba9-8174f6e869ee was raw, no need to convert to raw {{(pid=86846) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 11:56:29 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Flow 'volume_create_manager' (1d4f1f5a-84ae-4cd2-8a2b-b46cb94b2002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21980971-f8b1-4d60-81dc-6a38d46e5527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21980971-f8b1-4d60-81dc-6a38d46e5527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-990534218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f14376-ab8f-409d-948c-c6fac6046cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1974c1a276ff4c9fbf3f90b1e9f8615c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:56:30Z,use_quota=True,user_id='14c127c066da409ca924af40a3bbe481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89eee7e-095b-4b3d-b544-e21f041fc345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89eee7e-095b-4b3d-b544-e21f041fc345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b6ccc7-8806-42fa-87ea-13f4fd7397ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:30 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b6ccc7-8806-42fa-87ea-13f4fd7397ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95f14376-ab8f-409d-948c-c6fac6046cf4', 'volume_name': 'volume-95f14376-ab8f-409d-948c-c6fac6046cf4', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f890a-33c4-44b7-8c0f-639e90364a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f890a-33c4-44b7-8c0f-639e90364a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665a3d6a-33dc-4b19-872c-0f9b93c375db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Volume 95f14376-ab8f-409d-948c-c6fac6046cf4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95f14376-ab8f-409d-948c-c6fac6046cf4', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Trying to clone 95f14376-ab8f-409d-948c-c6fac6046cf4 from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:56:31 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Image download 20.69 MB at 20.69 MB/s Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b2519-b2ff-4bae-9ae8-ae9e67f5c209]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:31 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD Nov 02 11:56:31 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:31 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 is fetched for user 14c127c066da409ca924af40a3bbe481. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[832726ea-858a-4303-93cd-f7070ff93c3c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:31 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD Nov 02 11:56:31 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:32 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-17a13d79-d53b-4a1d-a566-4f1883552edd req-f74880a5-adcb-4fe0-b64c-3296bc40c84d tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.903s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Uploaded volume to glance image-id: f5f8854e-c1ad-469a-8ba9-8174f6e869ee. {{(pid=86846) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.599s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-990534218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f14376-ab8f-409d-948c-c6fac6046cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1974c1a276ff4c9fbf3f90b1e9f8615c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:56:30Z,use_quota=True,user_id='14c127c066da409ca924af40a3bbe481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Creating volume 95f14376-ab8f-409d-948c-c6fac6046cf4 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:56:45 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:56:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:45 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 1073741824 Nov 02 11:56:45 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1f1486bd-ba75-4bd9-98fc-f738c72417b8 tempest-TestImageHashVerification-156903059 None] Copy volume to image completed successfully. Nov 02 11:56:46 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 1073741824" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:46 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 Nov 02 11:56:46 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:46 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-17a13d79-d53b-4a1d-a566-4f1883552edd req-f74880a5-adcb-4fe0-b64c-3296bc40c84d tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.055s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-17a13d79-d53b-4a1d-a566-4f1883552edd req-f74880a5-adcb-4fe0-b64c-3296bc40c84d tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Attempting download of 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 95f14376-ab8f-409d-948c-c6fac6046cf4. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-17a13d79-d53b-4a1d-a566-4f1883552edd req-f74880a5-adcb-4fe0-b64c-3296bc40c84d tempest-TestServerVolumeAttachmentScenario-235950642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e4d2180-54db-486b-9882-472041de2a93', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a967fcf8-bc45-4520-9f4b-c565a9a15087]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_swtz9q_d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-17a13d79-d53b-4a1d-a566-4f1883552edd req-f74880a5-adcb-4fe0-b64c-3296bc40c84d tempest-TestServerVolumeAttachmentScenario-235950642 None] attachment_update completed successfully. Nov 02 11:56:46 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_swtz9q_d Nov 02 11:56:46 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:47 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_swtz9q_d" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_swtz9q_d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Acquiring lock "cinder-a436b6f2-517b-4f68-863c-1aa8f2babb7d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Lock "cinder-a436b6f2-517b-4f68-863c-1aa8f2babb7d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Acquiring lock "cinder-quobyte-a436b6f2-517b-4f68-863c-1aa8f2babb7d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:56:47 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_swtz9q_d Nov 02 11:56:47 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Lock "cinder-quobyte-a436b6f2-517b-4f68-863c-1aa8f2babb7d" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6580d1fb-c3f8-4f56-ad9f-80c7e0c0b255]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:47 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d Nov 02 11:56:47 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:47 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_swtz9q_d" returned: 1 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_swtz9q_d' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1448d9-e241-4c3e-b0f7-a58727b1edf5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:47 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD Nov 02 11:56:47 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:47 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d" returned: 0 in 0.434s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:47 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d Nov 02 11:56:47 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:47 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 was qcow2, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:47 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 Nov 02 11:56:47 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:47 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a436b6f2-517b-4f68-863c-1aa8f2babb7d" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Lock "cinder-quobyte-a436b6f2-517b-4f68-863c-1aa8f2babb7d" released by "delete_volume" :: held 0.757s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Created reservations ['23a617b8-a94f-4638-b80c-b453b0dc9adc', '85ab2f0d-cf90-493d-8de1-fa92467f3dea', '025228df-1bbd-44c8-a284-ec9b8a89983f', '7bf423bd-a895-4768-8fd8-c1a0c1b71fe3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:48 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:56:48 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:48 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:56:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Deleted volume successfully. Nov 02 11:56:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1e9e5b18-28c7-4fcd-96ed-801a471fd694 tempest-TestImageHashVerification-156903059 None] Lock "cinder-a436b6f2-517b-4f68-863c-1aa8f2babb7d-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:56:50 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4" returned: 0 in 2.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c42f72c-3cc7-45b0-bfaf-639d1b8db806_jpp1ljaddevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:56:50 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Converted 112.00 MB image at 46.11 MB/s Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:56:50 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 1G Nov 02 11:56:50 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:56:50 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 1G" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Downloaded image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}])) to volume 95f14376-ab8f-409d-948c-c6fac6046cf4 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Temporary image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 for user 14c127c066da409ca924af40a3bbe481 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Marking volume 95f14376-ab8f-409d-948c-c6fac6046cf4 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Copying metadata from image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 to 95f14376-ab8f-409d-948c-c6fac6046cf4. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Creating volume glance metadata for volume 95f14376-ab8f-409d-948c-c6fac6046cf4 backed by image 7c42f72c-3cc7-45b0-bfaf-639d1b8db806 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665a3d6a-33dc-4b19-872c-0f9b93c375db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f14376-ab8f-409d-948c-c6fac6046cf4', 'volume_size': 1, 'image_id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cf0a76cb6bbd4bb4b6d3d2bad40a4b43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7c42f72c-3cc7-45b0-bfaf-639d1b8db806', 'created_at': datetime.datetime(2026, 11, 2, 10, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c42f72c-3cc7-45b0-bfaf-639d1b8db806/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f20402-04ce-485b-8c98-27ec5fc1ff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:56:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Volume volume-95f14376-ab8f-409d-948c-c6fac6046cf4 (95f14376-ab8f-409d-948c-c6fac6046cf4): created successfully Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f20402-04ce-485b-8c98-27ec5fc1ff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:56:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Flow 'volume_create_manager' (1d4f1f5a-84ae-4cd2-8a2b-b46cb94b2002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:56:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-62e8f8cd-3a43-42d1-92d5-c91ff4268d14 tempest-TestShelveInstance-1097247295 None] Created volume successfully. Nov 02 11:56:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4cfc2ea4-6d52-45d8-9331-6f866f0aa9f7 req-361fff9e-92e6-4e9f-bce1-ca0f2e39e90c tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4cfc2ea4-6d52-45d8-9331-6f866f0aa9f7 req-361fff9e-92e6-4e9f-bce1-ca0f2e39e90c tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-4cfc2ea4-6d52-45d8-9331-6f866f0aa9f7 req-361fff9e-92e6-4e9f-bce1-ca0f2e39e90c tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-4cfc2ea4-6d52-45d8-9331-6f866f0aa9f7 req-361fff9e-92e6-4e9f-bce1-ca0f2e39e90c tempest-TestServerVolumeAttachmentScenario-235950642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f20fd52d-603d-4b5c-9c61-fd9740220774', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:56:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-4cfc2ea4-6d52-45d8-9331-6f866f0aa9f7 req-361fff9e-92e6-4e9f-bce1-ca0f2e39e90c tempest-TestServerVolumeAttachmentScenario-235950642 None] attachment_update completed successfully. Nov 02 11:56:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-e34ce0b8-5b1b-4b71-868c-cd168682ac19 req-7961d355-d2e0-4c26-917b-1b8eee0194f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Terminate volume connection completed successfully. Nov 02 11:56:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-e34ce0b8-5b1b-4b71-868c-cd168682ac19 req-7961d355-d2e0-4c26-917b-1b8eee0194f9 tempest-TestServerVolumeAttachmentScenario-235950642 None] Deleting attachment f20fd52d-603d-4b5c-9c61-fd9740220774. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:56:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-3beec97b-f8f1-4a98-bed4-0641638c0cb1 req-c1603cec-fad6-4f1e-8e78-7b9f3198cd7b tempest-TestServerVolumeAttachmentScenario-235950642 None] Terminate volume connection completed successfully. Nov 02 11:56:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-3beec97b-f8f1-4a98-bed4-0641638c0cb1 req-c1603cec-fad6-4f1e-8e78-7b9f3198cd7b tempest-TestServerVolumeAttachmentScenario-235950642 None] Deleting attachment 1e4d2180-54db-486b-9882-472041de2a93. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:56:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-50df276d-b7ff-407a-9474-1e7263a1066c req-92728585-f606-4a28-9e97-55f4b64aee76 tempest-TestShelveInstance-1097247295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:56:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-50df276d-b7ff-407a-9474-1e7263a1066c req-92728585-f606-4a28-9e97-55f4b64aee76 tempest-TestShelveInstance-1097247295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:56:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-50df276d-b7ff-407a-9474-1e7263a1066c req-92728585-f606-4a28-9e97-55f4b64aee76 tempest-TestShelveInstance-1097247295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:56:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-50df276d-b7ff-407a-9474-1e7263a1066c req-92728585-f606-4a28-9e97-55f4b64aee76 tempest-TestShelveInstance-1097247295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-95f14376-ab8f-409d-948c-c6fac6046cf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ecfb309-c027-4a57-b1e6-28a8419dea12', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:56:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-50df276d-b7ff-407a-9474-1e7263a1066c req-92728585-f606-4a28-9e97-55f4b64aee76 tempest-TestShelveInstance-1097247295 None] attachment_update completed successfully. Nov 02 11:57:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "cinder-2e540cd2-7d68-4a16-8bc3-8056fdab123d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-2e540cd2-7d68-4a16-8bc3-8056fdab123d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "cinder-quobyte-2e540cd2-7d68-4a16-8bc3-8056fdab123d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-quobyte-2e540cd2-7d68-4a16-8bc3-8056fdab123d" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8efd43d-6e0a-45e2-a19b-35c82e0bc52b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:01 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d Nov 02 11:57:01 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:02 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d" returned: 0 in 0.557s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:02 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d Nov 02 11:57:02 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:02 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2e540cd2-7d68-4a16-8bc3-8056fdab123d" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-quobyte-2e540cd2-7d68-4a16-8bc3-8056fdab123d" released by "delete_volume" :: held 0.896s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Created reservations ['03a55d66-5bca-4b50-b976-7aaea7d8715f', 'ebefd513-bd68-4c68-bf82-ebc1c2c2c1f6', '76237ba4-131f-486d-a7e9-2534bad79657', 'f9c1982b-7dfe-40e1-9b4e-57978b6856cf'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:02 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:02 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "cinder-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "cinder-quobyte-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-quobyte-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bdc6bd-1903-4d21-a36f-91014b9ff5be]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:03 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.522s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Deleted volume successfully. Nov 02 11:57:03 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 Nov 02 11:57:03 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b3aeeb1-2e56-4778-96db-0608393ce721 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-2e540cd2-7d68-4a16-8bc3-8056fdab123d-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:03 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9" returned: 0 in 0.654s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:03 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9 Nov 02 11:57:03 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:04 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-quobyte-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9" released by "delete_volume" :: held 1.233s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Created reservations ['7a4bcd8e-2b72-40b5-8bbb-6766cf2a3489', 'd521f2cd-0590-430a-ba1c-6e58a3564a2e', '0ed4d83e-9c33-4505-a959-39676e262ab2', '0ccc1a75-ca53-4a1c-bc75-5ef6594193c2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:04 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:04 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:04 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Deleted volume successfully. Nov 02 11:57:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-176c680c-1e0e-4669-8088-4e6a893f01f1 tempest-TestServerVolumeAttachmentScenario-235950642 None] Lock "cinder-4b1ab64e-2fd7-424c-8708-b5919ce2c8c9-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:14 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:57:14 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=44,cinder:UPDATE=35,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:57:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:57:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:19 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:19 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:19 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.317s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:57:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:57:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (9c3a9529-c8d7-41b3-aec5-244eacc1da10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a90ced-ab72-42f4-9e94-b22fc9d1a2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a90ced-ab72-42f4-9e94-b22fc9d1a2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174870268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1848bb4f-a03e-4ec9-a8ea-a49704b9c813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:22Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa80bfd6-4130-4028-8d07-d481eccb1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa80bfd6-4130-4028-8d07-d481eccb1148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575246e3-b52c-48f8-8ae6-d835c7baaa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575246e3-b52c-48f8-8ae6-d835c7baaa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1848bb4f-a03e-4ec9-a8ea-a49704b9c813', 'volume_name': 'volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cfa288-14d9-464e-bbb6-c9299cfa8abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cfa288-14d9-464e-bbb6-c9299cfa8abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea74ecdf-769e-40ec-a213-dea049c91c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:22 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume 1848bb4f-a03e-4ec9-a8ea-a49704b9c813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813', 'volume_size': 1} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174870268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1848bb4f-a03e-4ec9-a8ea-a49704b9c813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:22Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Creating volume 1848bb4f-a03e-4ec9-a8ea-a49704b9c813 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:22 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:22 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 1073741824 Nov 02 11:57:22 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:22 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 1073741824" returned: 0 in 0.587s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:22 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 Nov 02 11:57:22 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:23 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea74ecdf-769e-40ec-a213-dea049c91c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9856e4d-c0dd-4719-991b-58c4dad2d80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 (1848bb4f-a03e-4ec9-a8ea-a49704b9c813): created successfully Nov 02 11:57:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9856e4d-c0dd-4719-991b-58c4dad2d80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (9c3a9529-c8d7-41b3-aec5-244eacc1da10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1bce9500-7afa-4b98-9a64-4d505eb1ee4e tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created volume successfully. Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (9021ac0a-13ae-43b4-906f-34838a534321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee30e4d-7a4f-4ea0-a667-e7cdde0f94d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee30e4d-7a4f-4ea0-a667-e7cdde0f94d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044240934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602a5a97-a646-4f38-ba88-59709f66165a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:25Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e353b16-17c8-4b9a-bb6a-b2f334ce8c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e353b16-17c8-4b9a-bb6a-b2f334ce8c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c41c11-0632-4cc7-8d8b-a220e41b24b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c41c11-0632-4cc7-8d8b-a220e41b24b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602a5a97-a646-4f38-ba88-59709f66165a', 'volume_name': 'volume-602a5a97-a646-4f38-ba88-59709f66165a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74cb853-abea-4114-940e-f865f41de662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74cb853-abea-4114-940e-f865f41de662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fd7814-f15c-47c0-8b21-fc7abc7b3af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume 602a5a97-a646-4f38-ba88-59709f66165a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602a5a97-a646-4f38-ba88-59709f66165a', 'volume_size': 1} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044240934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602a5a97-a646-4f38-ba88-59709f66165a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:25Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Creating volume 602a5a97-a646-4f38-ba88-59709f66165a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:24 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:24 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a 1073741824 Nov 02 11:57:24 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (d0123ee3-a464-403a-8349-ead77c5933a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36792f93-8799-4b93-ba68-5500055a9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36792f93-8799-4b93-ba68-5500055a9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929226652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc65e6e-bf78-43dc-bc4b-45da2508140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:25Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925e58e0-d68f-4793-83c5-2c7059f09734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925e58e0-d68f-4793-83c5-2c7059f09734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8049db34-f2b8-4ff8-b3e4-47090628256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8049db34-f2b8-4ff8-b3e4-47090628256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc65e6e-bf78-43dc-bc4b-45da2508140e', 'volume_name': 'volume-afc65e6e-bf78-43dc-bc4b-45da2508140e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38663a0b-a627-4a25-ac27-077ecef8b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38663a0b-a627-4a25-ac27-077ecef8b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e0d68b-0596-43df-bfa5-8428d02e014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume afc65e6e-bf78-43dc-bc4b-45da2508140e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc65e6e-bf78-43dc-bc4b-45da2508140e', 'volume_size': 1} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:25 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a 1073741824" returned: 0 in 0.688s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (7a2046a8-f469-4407-aaea-ecad1a394f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93604818-7286-46c2-bd00-e9f0794bff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93604818-7286-46c2-bd00-e9f0794bff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-549613551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18439931-0854-4b92-be22-b87cf37ab8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:26Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a74b26-4900-4901-a179-71935cee1332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a74b26-4900-4901-a179-71935cee1332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142bc3f5-5cef-4e51-8d72-189dc4e43342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142bc3f5-5cef-4e51-8d72-189dc4e43342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18439931-0854-4b92-be22-b87cf37ab8f9', 'volume_name': 'volume-18439931-0854-4b92-be22-b87cf37ab8f9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a Nov 02 11:57:25 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddc1b76-7f29-4189-a149-9fec3e553f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddc1b76-7f29-4189-a149-9fec3e553f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a57f804-1a1c-4073-b4d9-33596cf474da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume 18439931-0854-4b92-be22-b87cf37ab8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18439931-0854-4b92-be22-b87cf37ab8f9', 'volume_size': 1} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:25 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929226652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc65e6e-bf78-43dc-bc4b-45da2508140e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:25Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Creating volume afc65e6e-bf78-43dc-bc4b-45da2508140e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:26 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fd7814-f15c-47c0-8b21-fc7abc7b3af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602a5a97-a646-4f38-ba88-59709f66165a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e 1073741824 Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa4d4a3-d1d1-48d8-9358-73a8eb81c14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume volume-602a5a97-a646-4f38-ba88-59709f66165a (602a5a97-a646-4f38-ba88-59709f66165a): created successfully Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa4d4a3-d1d1-48d8-9358-73a8eb81c14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (9021ac0a-13ae-43b4-906f-34838a534321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5293f4f5-8ff5-4ed2-8e15-bf9d23fa72b0 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created volume successfully. Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (199eed1f-c444-4550-bbbd-57996d14f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f23e51-567e-446a-89ee-1b3e8c3b4754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f23e51-567e-446a-89ee-1b3e8c3b4754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441016299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b9bc8c-e737-441e-a97e-71a6daf7558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:26Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00736fc-1761-4975-bfd8-1f81569ca68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00736fc-1761-4975-bfd8-1f81569ca68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e1d8cc-78bd-40e8-889d-70d788697596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e1d8cc-78bd-40e8-889d-70d788697596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b9bc8c-e737-441e-a97e-71a6daf7558f', 'volume_name': 'volume-10b9bc8c-e737-441e-a97e-71a6daf7558f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fcea2f-42d8-4d77-aa07-b7ddc61c4bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fcea2f-42d8-4d77-aa07-b7ddc61c4bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992bf7ec-3456-4ce6-87a7-7c8c8bb5c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume 10b9bc8c-e737-441e-a97e-71a6daf7558f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b9bc8c-e737-441e-a97e-71a6daf7558f', 'volume_size': 1} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:26 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e 1073741824" returned: 0 in 0.626s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:26 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e Nov 02 11:57:26 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (3a64bed8-ddbf-455f-89d2-426ea2ac51b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e83fd8-ea74-4445-931e-d7ca32cf91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e83fd8-ea74-4445-931e-d7ca32cf91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280680445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2289157f-9feb-46b4-99da-93336d7da239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:27Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3631b92c-055f-4767-92c7-a9bc2c2ae82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3631b92c-055f-4767-92c7-a9bc2c2ae82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bdc826-4d74-4d09-b5d1-18c41871bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bdc826-4d74-4d09-b5d1-18c41871bf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2289157f-9feb-46b4-99da-93336d7da239', 'volume_name': 'volume-2289157f-9feb-46b4-99da-93336d7da239', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd28858-e54a-4932-951b-12b8d1a62195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd28858-e54a-4932-951b-12b8d1a62195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7578b9-dc13-490f-9a06-f90a83496d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume 2289157f-9feb-46b4-99da-93336d7da239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2289157f-9feb-46b4-99da-93336d7da239', 'volume_size': 1} Nov 02 11:57:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:27 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-549613551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18439931-0854-4b92-be22-b87cf37ab8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:26Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Creating volume 18439931-0854-4b92-be22-b87cf37ab8f9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:27 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e0d68b-0596-43df-bfa5-8428d02e014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc65e6e-bf78-43dc-bc4b-45da2508140e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5441e5-7d89-4afe-83de-7eab8e654459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:27 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 1073741824 Nov 02 11:57:27 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume volume-afc65e6e-bf78-43dc-bc4b-45da2508140e (afc65e6e-bf78-43dc-bc4b-45da2508140e): created successfully Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5441e5-7d89-4afe-83de-7eab8e654459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (d0123ee3-a464-403a-8349-ead77c5933a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6b2547d1-1660-4a18-b439-81e683784734 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created volume successfully. Nov 02 11:57:27 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 1073741824" returned: 0 in 0.707s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:27 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 Nov 02 11:57:27 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:28 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9" returned: 0 in 0.324s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441016299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b9bc8c-e737-441e-a97e-71a6daf7558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:26Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Creating volume 10b9bc8c-e737-441e-a97e-71a6daf7558f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a57f804-1a1c-4073-b4d9-33596cf474da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18439931-0854-4b92-be22-b87cf37ab8f9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6716a2-d371-4bc9-b3a5-6bfd8fbc78ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:28 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f 1073741824 Nov 02 11:57:28 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume volume-18439931-0854-4b92-be22-b87cf37ab8f9 (18439931-0854-4b92-be22-b87cf37ab8f9): created successfully Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6716a2-d371-4bc9-b3a5-6bfd8fbc78ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (7a2046a8-f469-4407-aaea-ecad1a394f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2fac3f2c-7281-49b0-94c2-ab1ba610f9ba tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created volume successfully. Nov 02 11:57:28 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f 1073741824" returned: 0 in 0.662s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:28 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f Nov 02 11:57:28 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:29 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.363s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280680445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2289157f-9feb-46b4-99da-93336d7da239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f046af88034764930eb5e2c896ec34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:27Z,use_quota=True,user_id='be9ed516d2704dca977855e127c0e51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Creating volume 2289157f-9feb-46b4-99da-93336d7da239 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:29 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992bf7ec-3456-4ce6-87a7-7c8c8bb5c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b9bc8c-e737-441e-a97e-71a6daf7558f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598d2364-fa92-4209-a3f9-d5a2a755e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:29 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 1073741824 Nov 02 11:57:29 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:29 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume volume-10b9bc8c-e737-441e-a97e-71a6daf7558f (10b9bc8c-e737-441e-a97e-71a6daf7558f): created successfully Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598d2364-fa92-4209-a3f9-d5a2a755e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (199eed1f-c444-4550-bbbd-57996d14f124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:29 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-33a08483-39aa-46cc-b0e8-4bdd173b2032 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created volume successfully. Nov 02 11:57:29 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 1073741824" returned: 0 in 0.632s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:29 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 Nov 02 11:57:29 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:30 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7578b9-dc13-490f-9a06-f90a83496d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2289157f-9feb-46b4-99da-93336d7da239', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e008e8f4-5b56-44a4-9271-acfd60248eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:30 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Volume volume-2289157f-9feb-46b4-99da-93336d7da239 (2289157f-9feb-46b4-99da-93336d7da239): created successfully Nov 02 11:57:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e008e8f4-5b56-44a4-9271-acfd60248eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Flow 'volume_create_manager' (3a64bed8-ddbf-455f-89d2-426ea2ac51b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-495fa1cd-5073-4063-96d5-2d69e9bfbc0d tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created volume successfully. Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-2289157f-9feb-46b4-99da-93336d7da239-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-2289157f-9feb-46b4-99da-93336d7da239-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-quobyte-2289157f-9feb-46b4-99da-93336d7da239" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-2289157f-9feb-46b4-99da-93336d7da239" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b03036-13ca-49be-a545-fd3b84d02e5b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:31 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 Nov 02 11:57:31 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:31 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239" returned: 0 in 0.433s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:31 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239 Nov 02 11:57:31 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Flow 'volume_create_manager' (b4c19eac-ad9c-4599-815b-78bb9d1a468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10a6a80-c209-4dd2-ac37-e59a990c0b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10a6a80-c209-4dd2-ac37-e59a990c0b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-63071297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41554c1f-b7b8-4619-b14b-7231a376a3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a15827ec4145dc9bd1fa4a7b55a2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:32Z,use_quota=True,user_id='c09c3d46f83b46fa86e1c366682eb516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb17bb36-0b71-4e13-b36e-075f5eb6ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb17bb36-0b71-4e13-b36e-075f5eb6ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46640721-ed4c-4e46-9a1f-a76c4db2284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46640721-ed4c-4e46-9a1f-a76c4db2284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41554c1f-b7b8-4619-b14b-7231a376a3e1', 'volume_name': 'volume-41554c1f-b7b8-4619-b14b-7231a376a3e1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fee0d6-72f4-4568-a155-4056ef7b5c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fee0d6-72f4-4568-a155-4056ef7b5c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bf47d8-2d1a-4f93-a4e9-9da15449b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Volume 41554c1f-b7b8-4619-b14b-7231a376a3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41554c1f-b7b8-4619-b14b-7231a376a3e1', 'volume_size': 1} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-63071297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41554c1f-b7b8-4619-b14b-7231a376a3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a15827ec4145dc9bd1fa4a7b55a2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:32Z,use_quota=True,user_id='c09c3d46f83b46fa86e1c366682eb516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Creating volume 41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:31 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 1073741824 Nov 02 11:57:31 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:32 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2289157f-9feb-46b4-99da-93336d7da239" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-2289157f-9feb-46b4-99da-93336d7da239" released by "delete_volume" :: held 0.761s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created reservations ['1f77837b-548d-4bab-8b84-7ddf6814ff83', '7606df64-30ad-41a4-8c1a-25df2fcf66c0', 'fe24c9b4-83a8-4776-b035-62695c3773e1', 'cef9e8dc-aeb7-430c-bbae-e9ac1af200b1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:32 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:32 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-10b9bc8c-e737-441e-a97e-71a6daf7558f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-10b9bc8c-e737-441e-a97e-71a6daf7558f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:32 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 1073741824" returned: 0 in 0.577s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-quobyte-10b9bc8c-e737-441e-a97e-71a6daf7558f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-10b9bc8c-e737-441e-a97e-71a6daf7558f" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:32 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2bcb0-c708-43f3-a6be-1e353d0426dc]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:32 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 Nov 02 11:57:32 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Deleted volume successfully. Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e271bcbc-f94c-4524-aa5e-743db787ac25 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-2289157f-9feb-46b4-99da-93336d7da239-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:32 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f Nov 02 11:57:32 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:32 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1" returned: 0 in 0.304s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bf47d8-2d1a-4f93-a4e9-9da15449b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41554c1f-b7b8-4619-b14b-7231a376a3e1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9048e6-6298-4130-be96-ca31fa3aa4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Volume volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 (41554c1f-b7b8-4619-b14b-7231a376a3e1): created successfully Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9048e6-6298-4130-be96-ca31fa3aa4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Flow 'volume_create_manager' (b4c19eac-ad9c-4599-815b-78bb9d1a468d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e2fe4445-a105-4f10-a07c-5be2aa138ef7 tempest-TestStampPattern-1608186782 None] Created volume successfully. Nov 02 11:57:33 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:33 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f Nov 02 11:57:33 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:33 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-10b9bc8c-e737-441e-a97e-71a6daf7558f" returned: 0 in 0.269s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-10b9bc8c-e737-441e-a97e-71a6daf7558f" released by "delete_volume" :: held 0.798s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created reservations ['804b78ad-c368-4022-b3de-e55ce3f3a7ac', 'abcdba79-7257-4750-a4d9-631c2a756502', '9ee9347d-0dac-47f1-a400-5ab9585e3211', '6f343d46-e11f-4a83-939b-528cde29fb0d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:33 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:33 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-18439931-0854-4b92-be22-b87cf37ab8f9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-18439931-0854-4b92-be22-b87cf37ab8f9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-quobyte-18439931-0854-4b92-be22-b87cf37ab8f9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:33 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-18439931-0854-4b92-be22-b87cf37ab8f9" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Deleted volume successfully. Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9978bca7-4464-4a7e-a110-01bdcb3a0034]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4ff287dc-a50c-42f5-9d2d-4af7d565e9fa tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-10b9bc8c-e737-441e-a97e-71a6daf7558f-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:34 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 Nov 02 11:57:34 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:34 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:34 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9 Nov 02 11:57:34 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:34 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-18439931-0854-4b92-be22-b87cf37ab8f9" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-18439931-0854-4b92-be22-b87cf37ab8f9" released by "delete_volume" :: held 0.783s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created reservations ['8f76d473-b5a5-453b-8b19-5e2e93702d71', '15c36846-7bfc-41d2-ab57-8ad5cf89aff1', 'b0a23fe3-5a02-4336-b936-3e671cc0367f', '81774f78-4626-42af-9778-30a24bb24b97'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:34 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:34 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-afc65e6e-bf78-43dc-bc4b-45da2508140e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-afc65e6e-bf78-43dc-bc4b-45da2508140e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-quobyte-afc65e6e-bf78-43dc-bc4b-45da2508140e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-afc65e6e-bf78-43dc-bc4b-45da2508140e" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c5d3a0-462e-402a-89c0-c1208d223074]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:35 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.377s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Deleted volume successfully. Nov 02 11:57:35 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e Nov 02 11:57:35 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7527b12f-b48e-4739-85e6-7a1f948ce33a tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-18439931-0854-4b92-be22-b87cf37ab8f9-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:35 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e" returned: 0 in 0.398s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:35 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e Nov 02 11:57:35 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:35 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-afc65e6e-bf78-43dc-bc4b-45da2508140e" returned: 0 in 0.255s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-afc65e6e-bf78-43dc-bc4b-45da2508140e" released by "delete_volume" :: held 0.713s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created reservations ['d48be165-d978-48f3-acf8-f0ebab055fb3', 'f9fe782f-9b4c-49f3-9151-7033c5b4af60', '8c723d3e-25e5-4952-b1bb-41de6233a339', '2e916af4-067b-4e3a-9fa3-f6cb5eb464ac'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:35 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:35 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-602a5a97-a646-4f38-ba88-59709f66165a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-602a5a97-a646-4f38-ba88-59709f66165a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-quobyte-602a5a97-a646-4f38-ba88-59709f66165a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:36 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.307s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-602a5a97-a646-4f38-ba88-59709f66165a" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Deleted volume successfully. Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d48ae7-1c70-456a-be4a-aacaa64f6d39]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-651b23a4-e09d-4a2e-b16f-d14486768051 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-afc65e6e-bf78-43dc-bc4b-45da2508140e-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:36 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a Nov 02 11:57:36 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:36 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a" returned: 0 in 0.389s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:36 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a Nov 02 11:57:36 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:37 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-602a5a97-a646-4f38-ba88-59709f66165a" returned: 0 in 0.444s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-602a5a97-a646-4f38-ba88-59709f66165a" released by "delete_volume" :: held 0.897s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created reservations ['029407f1-f9dc-47c7-800a-834dcd9118a9', '0d9951a6-c2d6-401e-b900-e386907ff212', 'a4a2da1a-c9a5-447c-9364-302730225829', '6e260cde-260b-40e7-a74a-7d8198ea4d57'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:37 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:37 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-1848bb4f-a03e-4ec9-a8ea-a49704b9c813-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-1848bb4f-a03e-4ec9-a8ea-a49704b9c813-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "cinder-quobyte-1848bb4f-a03e-4ec9-a8ea-a49704b9c813" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-1848bb4f-a03e-4ec9-a8ea-a49704b9c813" acquired by "delete_volume" :: waited 0.040s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d3f070-831e-41bd-a511-3dd982b4317a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:38 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 Nov 02 11:57:38 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:38 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.620s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Deleted volume successfully. Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d4e7348-7ccd-4ffe-ab68-f197b5adedc9 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-602a5a97-a646-4f38-ba88-59709f66165a-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:38 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813" returned: 0 in 0.618s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:38 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813 Nov 02 11:57:38 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:38 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1848bb4f-a03e-4ec9-a8ea-a49704b9c813" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-quobyte-1848bb4f-a03e-4ec9-a8ea-a49704b9c813" released by "delete_volume" :: held 1.016s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Created reservations ['de9e9989-af07-4c97-bd4b-b264dc36dc79', 'f3bdacd6-4c67-4423-b41e-aaa76b9c38a5', '51c17693-5781-438e-b310-2ca513fe0c6e', '7df23f02-ebb3-4c4f-bcfc-50609b9017f3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:38 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:57:38 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:39 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.236s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:39 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:57:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Deleted volume successfully. Nov 02 11:57:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5c0697af-049d-4fff-ba02-56b8949f6750 tempest-CreateVolumesFromSourceVolumeTest-1189241292 None] Lock "cinder-1848bb4f-a03e-4ec9-a8ea-a49704b9c813-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Flow 'volume_create_manager' (81a7b8b8-d101-4850-a9f4-e6bcd86630f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af41a267-c1d9-4f3e-902a-ee253b8966bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af41a267-c1d9-4f3e-902a-ee253b8966bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-859003763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99967ae-dddd-46cf-9fec-540a1febb902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb8f009d2ce4be4904b7599091d36f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:43Z,use_quota=True,user_id='6e73d388a51b4ed1b19eafb1c20de9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53fe719-0527-4a22-abd5-9962ef08797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53fe719-0527-4a22-abd5-9962ef08797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4426c050-4005-4c15-9ffa-54b39ac51b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4426c050-4005-4c15-9ffa-54b39ac51b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99967ae-dddd-46cf-9fec-540a1febb902', 'volume_name': 'volume-f99967ae-dddd-46cf-9fec-540a1febb902', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc05d2c-c207-443d-b322-abd0c725890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc05d2c-c207-443d-b322-abd0c725890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fba700-8a19-4305-9119-6fcfcbcb6908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Volume f99967ae-dddd-46cf-9fec-540a1febb902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99967ae-dddd-46cf-9fec-540a1febb902', 'volume_size': 1} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-859003763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99967ae-dddd-46cf-9fec-540a1febb902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb8f009d2ce4be4904b7599091d36f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:43Z,use_quota=True,user_id='6e73d388a51b4ed1b19eafb1c20de9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Creating volume f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:43 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:43 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 1073741824 Nov 02 11:57:43 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:43 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 1073741824" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:43 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 Nov 02 11:57:43 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:44 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:57:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fba700-8a19-4305-9119-6fcfcbcb6908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99967ae-dddd-46cf-9fec-540a1febb902', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca406bd-6f9c-4c25-b496-2ad27de57d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Volume volume-f99967ae-dddd-46cf-9fec-540a1febb902 (f99967ae-dddd-46cf-9fec-540a1febb902): created successfully Nov 02 11:57:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca406bd-6f9c-4c25-b496-2ad27de57d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Flow 'volume_create_manager' (81a7b8b8-d101-4850-a9f4-e6bcd86630f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e8abc9d6-4a63-46c6-b95a-5fe4ef4cd61c tempest-VolumeDependencyTests-1546130645 None] Created volume successfully. Nov 02 11:57:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Creating offline snapshot 1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a of volume f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:57:45 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7873290-c72a-4b37-883f-a61a42f82951]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:45 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 Nov 02 11:57:45 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:46 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902" returned: 0 in 0.594s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:46 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a 1G Nov 02 11:57:46 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-f08e81d5-5d4d-403a-aab9-8a83037dded1 req-5ed167ee-b8ae-48d0-83f0-02f9b44b6d8d tempest-TestShelveInstance-1097247295 None] Terminate volume connection completed successfully. Nov 02 11:57:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-f08e81d5-5d4d-403a-aab9-8a83037dded1 req-5ed167ee-b8ae-48d0-83f0-02f9b44b6d8d tempest-TestShelveInstance-1097247295 None] Deleting attachment 4ecfb309-c027-4a57-b1e6-28a8419dea12. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:57:46 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a 1G" returned: 0 in 0.577s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99967ae-dddd-46cf-9fec-540a1febb902 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:46 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99967ae-dddd-46cf-9fec-540a1febb902 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a Nov 02 11:57:46 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:47 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f99967ae-dddd-46cf-9fec-540a1febb902 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a is being set with open permissions: ugo+rw Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:47 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a Nov 02 11:57:47 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:47 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:47 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.info Nov 02 11:57:47 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:47 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.info" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:47 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.info is being set with open permissions: ugo+rw Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:47 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.info Nov 02 11:57:47 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:47 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.info" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-13622605-771d-496d-ae85-a0abc541a1e4 tempest-VolumeDependencyTests-1546130645 None] Create snapshot completed successfully Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Flow 'volume_create_manager' (c7a13d4a-510e-4c8e-b976-1b463ca45f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afec990-edaa-42bf-bb2f-2bbfff66d093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afec990-edaa-42bf-bb2f-2bbfff66d093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-470135211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818e879e-c184-464c-a731-4bc1118d0d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb8f009d2ce4be4904b7599091d36f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:57:49Z,use_quota=True,user_id='6e73d388a51b4ed1b19eafb1c20de9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d249997-f7bf-4321-a4ed-7cf3eb360ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d249997-f7bf-4321-a4ed-7cf3eb360ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975ddadd-71c3-40c1-bb35-5adbae67fafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975ddadd-71c3-40c1-bb35-5adbae67fafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '818e879e-c184-464c-a731-4bc1118d0d10', 'volume_name': 'volume-818e879e-c184-464c-a731-4bc1118d0d10', 'volume_size': 1, 'snapshot_id': '1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a26fc60-fc71-47df-967b-f8b4e7c629a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a26fc60-fc71-47df-967b-f8b4e7c629a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009e8247-df84-407c-96fd-f6a6b62fe63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Volume 818e879e-c184-464c-a731-4bc1118d0d10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-818e879e-c184-464c-a731-4bc1118d0d10', 'volume_size': 1, 'snapshot_id': '1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a'} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-quobyte-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a-818e879e-c184-464c-a731-4bc1118d0d10" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a-818e879e-c184-464c-a731-4bc1118d0d10" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Creating volume 818e879e-c184-464c-a731-4bc1118d0d10 from snapshot 1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-quobyte-818e879e-c184-464c-a731-4bc1118d0d10" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-818e879e-c184-464c-a731-4bc1118d0d10" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] snapshot: 1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a, volume: 818e879e-c184-464c-a731-4bc1118d0d10, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[813ca701-1262-428f-89ab-fb1022a9300c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:49 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a Nov 02 11:57:49 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-e4224576-5807-4823-88b3-946250eaf8d3 req-d9b01a2f-939a-4a25-9570-23c4dad80a74 tempest-TestShelveInstance-1097247295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:57:49 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" returned: 0 in 0.464s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f99967ae-dddd-46cf-9fec-540a1febb902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[37220aab-46c9-4476-9443-e2b2bde4eca9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:50 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 Nov 02 11:57:50 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:50 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902" returned: 0 in 0.363s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:57:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:57:50 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:57:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:50 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 Nov 02 11:57:50 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:56 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10" returned: 0 in 6.245s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:57:56 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Converted 1024.00 MB image at 163.92 MB/s Nov 02 11:57:56 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 is being set with open permissions: ugo+rw Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:56 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 Nov 02 11:57:56 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:56 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10" returned: 0 in 0.280s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-818e879e-c184-464c-a731-4bc1118d0d10" released by "_copy_volume_from_snapshot" :: held 7.452s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a-818e879e-c184-464c-a731-4bc1118d0d10" released by "_create_volume_from_snapshot" :: held 7.530s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.549s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-e4224576-5807-4823-88b3-946250eaf8d3 req-d9b01a2f-939a-4a25-9570-23c4dad80a74 tempest-TestShelveInstance-1097247295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.062s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-e4224576-5807-4823-88b3-946250eaf8d3 req-d9b01a2f-939a-4a25-9570-23c4dad80a74 tempest-TestShelveInstance-1097247295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009e8247-df84-407c-96fd-f6a6b62fe63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818e879e-c184-464c-a731-4bc1118d0d10', 'volume_size': 1, 'snapshot_id': '1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2df4280-6322-4e95-ae35-72b3db483134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:57:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Volume volume-818e879e-c184-464c-a731-4bc1118d0d10 (818e879e-c184-464c-a731-4bc1118d0d10): created successfully Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2df4280-6322-4e95-ae35-72b3db483134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Flow 'volume_create_manager' (c7a13d4a-510e-4c8e-b976-1b463ca45f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:57:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-e4224576-5807-4823-88b3-946250eaf8d3 req-d9b01a2f-939a-4a25-9570-23c4dad80a74 tempest-TestShelveInstance-1097247295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-95f14376-ab8f-409d-948c-c6fac6046cf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3826df9b-32c6-4104-830b-ee8628e09c19', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:57:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-52a4bbef-2a9a-49c8-9382-a8644fd6e389 tempest-VolumeDependencyTests-1546130645 None] Created volume successfully. Nov 02 11:57:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-e4224576-5807-4823-88b3-946250eaf8d3 req-d9b01a2f-939a-4a25-9570-23c4dad80a74 tempest-TestShelveInstance-1097247295 None] attachment_update completed successfully. Nov 02 11:57:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-quobyte-f99967ae-dddd-46cf-9fec-540a1febb902" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-f99967ae-dddd-46cf-9fec-540a1febb902" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-quobyte-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:57:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:57:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Deleting offline snapshot 1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a of volume f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:57:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] snapshot_file for this snap is: volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:57:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[797a655c-4e18-4326-946b-6216977fd9b1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:58 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a Nov 02 11:57:58 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:58 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" returned: 0 in 0.431s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f99967ae-dddd-46cf-9fec-540a1febb902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:57:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a649f2f-2d85-4f15-b25c-4412d6b43714]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:57:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:58 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 Nov 02 11:57:58 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:59 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902" returned: 0 in 0.658s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:59 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a Nov 02 11:57:59 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:57:59 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Nov 02 11:57:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:57:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:57:59 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a Nov 02 11:57:59 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:00 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902.1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a" released by "_delete_snapshot" :: held 2.150s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-f99967ae-dddd-46cf-9fec-540a1febb902" released by "delete_snapshot" :: held 2.176s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Created reservations ['56b4f402-53a7-4fd6-92b6-b29cdaf36144', '5f0fafc2-5aff-41ca-a9ef-4d6ed66ee253', '4fee06c6-3821-4bc2-aa1f-5eac391a998a', '36284175-6184-456f-a7fa-df6d65a11a0d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:58:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Delete snapshot completed successfully. Nov 02 11:58:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-953eda6c-5123-4de8-afb3-a5ca2a1afffd tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-1bdf7c8e-e4f8-41d3-96fe-abf2b1d0224a-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-f99967ae-dddd-46cf-9fec-540a1febb902-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-f99967ae-dddd-46cf-9fec-540a1febb902-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-quobyte-f99967ae-dddd-46cf-9fec-540a1febb902" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-f99967ae-dddd-46cf-9fec-540a1febb902" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee36b2a-6112-4a64-b255-b663c4029030]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:01 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 Nov 02 11:58:01 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:01 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:01 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902 Nov 02 11:58:01 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:02 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f99967ae-dddd-46cf-9fec-540a1febb902" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-f99967ae-dddd-46cf-9fec-540a1febb902" released by "delete_volume" :: held 0.781s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Created reservations ['9caf371b-ccdd-4a5d-9dcd-ccdf4ee4ad7f', '8c2cca46-1dcc-4f3e-a9df-7a759a08b79c', '31c7ad5a-12ec-4924-a0f7-0b0d78cc1238', '991027a8-1f2a-4dc7-913b-0bbb3c6330dd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:02 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:58:02 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-818e879e-c184-464c-a731-4bc1118d0d10-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-818e879e-c184-464c-a731-4bc1118d0d10-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "cinder-quobyte-818e879e-c184-464c-a731-4bc1118d0d10" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-818e879e-c184-464c-a731-4bc1118d0d10" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da0215c-636d-4c82-8ee2-696e2dc7bb2e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:02 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.493s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:58:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Deleted volume successfully. Nov 02 11:58:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c0abfd89-9a5d-43db-a441-f3546c8e0fda tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-f99967ae-dddd-46cf-9fec-540a1febb902-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:02 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 Nov 02 11:58:02 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:03 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10" returned: 0 in 0.548s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:03 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10 Nov 02 11:58:03 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fcd33f13-90be-4301-871d-d517d7ba9ee0 req-fe71c9ab-fb26-4a52-9610-da690b65f048 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fcd33f13-90be-4301-871d-d517d7ba9ee0 req-fe71c9ab-fb26-4a52-9610-da690b65f048 tempest-TestStampPattern-1608186782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-fcd33f13-90be-4301-871d-d517d7ba9ee0 req-fe71c9ab-fb26-4a52-9610-da690b65f048 tempest-TestStampPattern-1608186782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:03 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-818e879e-c184-464c-a731-4bc1118d0d10" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-quobyte-818e879e-c184-464c-a731-4bc1118d0d10" released by "delete_volume" :: held 0.984s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-fcd33f13-90be-4301-871d-d517d7ba9ee0 req-fe71c9ab-fb26-4a52-9610-da690b65f048 tempest-TestStampPattern-1608186782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-41554c1f-b7b8-4619-b14b-7231a376a3e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9c7564f-f582-4339-99bb-894656123267', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Created reservations ['75b83794-7fde-493d-87e8-8df8ca0d542d', '6c83923c-f812-459e-b9b2-d0049e9162d2', '20376d8a-44fd-40b0-a830-99d78f9eb2f5', '6b942f3f-da10-47eb-a2f4-577bf36e336c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:58:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-fcd33f13-90be-4301-871d-d517d7ba9ee0 req-fe71c9ab-fb26-4a52-9610-da690b65f048 tempest-TestStampPattern-1608186782 None] attachment_update completed successfully. Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:03 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:58:03 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:04 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:04 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:58:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Deleted volume successfully. Nov 02 11:58:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-addd7105-b26b-4982-9054-400f9fec7d85 tempest-VolumeDependencyTests-1546130645 None] Lock "cinder-818e879e-c184-464c-a731-4bc1118d0d10-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-faf39cd7-be7b-4358-ab3a-21eae6e08403 req-7aa60b1e-fb42-47ce-9d8c-9a33024723f6 tempest-TestStampPattern-1608186782 None] Terminate volume connection completed successfully. Nov 02 11:58:09 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-faf39cd7-be7b-4358-ab3a-21eae6e08403 req-7aa60b1e-fb42-47ce-9d8c-9a33024723f6 tempest-TestStampPattern-1608186782 None] Deleting attachment e9c7564f-f582-4339-99bb-894656123267. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:58:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Creating offline snapshot f0014749-db3f-4590-b560-612c818b4511 of volume 41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:58:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13376e-ff65-4501-a1cd-be91d5cd2450]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:10 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 Nov 02 11:58:10 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:10 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1" returned: 0 in 0.394s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:10 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 1G Nov 02 11:58:10 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:58:11 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Flow 'volume_create_manager' (7bf4b7e4-8db8-48e4-9b98-8dd63e5049a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c22afd-31cb-42f3-bc2d-b861a594de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 1G" returned: 0 in 0.498s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:11 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 Nov 02 11:58:11 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c22afd-31cb-42f3-bc2d-b861a594de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329a8b6f-c574-455b-aa45-3c02b7258e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef7210dd4c94a509dfcdef7b99dbafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:58:11Z,use_quota=True,user_id='5f0f35c2ebca43f6892181807966ade5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282994c9-1ab7-44ed-8dab-e69bdb7d7688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282994c9-1ab7-44ed-8dab-e69bdb7d7688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98aa8d4-8a4d-462f-ade1-e20da0c62273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:58:11 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511" returned: 0 in 0.317s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:11 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 is being set with open permissions: ugo+rw Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98aa8d4-8a4d-462f-ade1-e20da0c62273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '329a8b6f-c574-455b-aa45-3c02b7258e9f', 'volume_name': 'volume-329a8b6f-c574-455b-aa45-3c02b7258e9f', 'volume_size': 1, 'image_id': '3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1efc22988253b89cde13f537ca37d49', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aef7210dd4c94a509dfcdef7b99dbafb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4534e08ee36bb548053ff25472caa987e9355499592ef784270294b5a7048df73e5eb697468cad3c817b27df5d624454e5a835b0f3b52909668061f104a6b96e', 'id': '3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'created_at': datetime.datetime(2026, 11, 2, 10, 58, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 58, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dab9868-873d-42b9-bdc2-fa0eec899510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:11 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 Nov 02 11:58:11 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dab9868-873d-42b9-bdc2-fa0eec899510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e594e324-ac5c-4490-83bc-172466054c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Volume 329a8b6f-c574-455b-aa45-3c02b7258e9f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-329a8b6f-c574-455b-aa45-3c02b7258e9f', 'volume_size': 1, 'image_id': '3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1efc22988253b89cde13f537ca37d49', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aef7210dd4c94a509dfcdef7b99dbafb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4534e08ee36bb548053ff25472caa987e9355499592ef784270294b5a7048df73e5eb697468cad3c817b27df5d624454e5a835b0f3b52909668061f104a6b96e', 'id': '3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'created_at': datetime.datetime(2026, 11, 2, 10, 58, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 58, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c/file', 'properties': {}}, 'image_service': } Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Trying to clone 329a8b6f-c574-455b-aa45-3c02b7258e9f from image 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 11:58:11 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Image download 0.00 MB at 0.00 MB/s Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d41dd84-2d40-43cc-b875-d60add279ac6]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:11 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:11 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD Nov 02 11:58:11 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:11 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.info Nov 02 11:58:11 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:12 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:12 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.info" returned: 0 in 0.284s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:12 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.info is being set with open permissions: ugo+rw Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:12 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.info Nov 02 11:58:12 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:12 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD Nov 02 11:58:12 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:12 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.info" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3151d3a7-7b76-4633-8859-adf47704b588 tempest-TestStampPattern-1608186782 None] Create snapshot completed successfully Nov 02 11:58:12 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Temporary image 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c is fetched for user 5f0f35c2ebca43f6892181807966ade5. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44c971-bfc6-436f-bc26-96735ed08d15]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:12 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD Nov 02 11:58:12 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:12 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:12 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD Nov 02 11:58:12 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:13 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329a8b6f-c574-455b-aa45-3c02b7258e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef7210dd4c94a509dfcdef7b99dbafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:58:11Z,use_quota=True,user_id='5f0f35c2ebca43f6892181807966ade5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Creating volume 329a8b6f-c574-455b-aa45-3c02b7258e9f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:58:13 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:13 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f 1073741824 Nov 02 11:58:13 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:13 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f 1073741824" returned: 0 in 0.480s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:13 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f Nov 02 11:58:13 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:13 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f" returned: 0 in 0.258s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Attempting download of 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c ((None, [{'url': 'file:///opt/stack/data/glance/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'metadata': {}}])) to volume 329a8b6f-c574-455b-aa45-3c02b7258e9f. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cf7a9f-147f-4eb2-b4b1-b23f8aca0c4d]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_t58i9fal {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:14 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_t58i9fal Nov 02 11:58:14 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:14 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_t58i9fal" returned: 0 in 0.368s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_t58i9fal {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:14 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_t58i9fal Nov 02 11:58:14 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:14 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_t58i9fal" returned: 1 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_t58i9fal' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:58:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[187e683a-3fee-47e5-a035-0f7fd298790c]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:14 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD Nov 02 11:58:14 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:15 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:15 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD Nov 02 11:58:15 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:15 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:58:15 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 11:58:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:15 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f Nov 02 11:58:15 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:16 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f" returned: 0 in 0.445s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f3275a7-20ff-4ef6-a402-73e3aeceeb3c_95i96ijddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:58:16 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:16 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f 1G Nov 02 11:58:16 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:16 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f 1G" returned: 0 in 0.374s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Downloaded image 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c ((None, [{'url': 'file:///opt/stack/data/glance/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'metadata': {}}])) to volume 329a8b6f-c574-455b-aa45-3c02b7258e9f successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Temporary image 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c for user 5f0f35c2ebca43f6892181807966ade5 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Marking volume 329a8b6f-c574-455b-aa45-3c02b7258e9f as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=116,cinder:SELECT=84,cinder:DELETE=14,cinder:INSERT=24 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Copying metadata from image 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c to 329a8b6f-c574-455b-aa45-3c02b7258e9f. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Creating volume glance metadata for volume 329a8b6f-c574-455b-aa45-3c02b7258e9f backed by image 3f3275a7-20ff-4ef6-a402-73e3aeceeb3c with: {'image_id': '3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e1efc22988253b89cde13f537ca37d49', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=97,cinder:UPDATE=95,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e594e324-ac5c-4490-83bc-172466054c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329a8b6f-c574-455b-aa45-3c02b7258e9f', 'volume_size': 1, 'image_id': '3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1efc22988253b89cde13f537ca37d49', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aef7210dd4c94a509dfcdef7b99dbafb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4534e08ee36bb548053ff25472caa987e9355499592ef784270294b5a7048df73e5eb697468cad3c817b27df5d624454e5a835b0f3b52909668061f104a6b96e', 'id': '3f3275a7-20ff-4ef6-a402-73e3aeceeb3c', 'created_at': datetime.datetime(2026, 11, 2, 10, 58, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 58, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f3275a7-20ff-4ef6-a402-73e3aeceeb3c/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fc1de2-62a6-4b14-ab74-3e7b95d32c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Volume volume-329a8b6f-c574-455b-aa45-3c02b7258e9f (329a8b6f-c574-455b-aa45-3c02b7258e9f): created successfully Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fc1de2-62a6-4b14-ab74-3e7b95d32c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Flow 'volume_create_manager' (7bf4b7e4-8db8-48e4-9b98-8dd63e5049a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7edd622f-4510-45e9-bb17-6e2c820a0f51 tempest-VolumeImageDependencyTests-1026820325 None] Created volume successfully. Nov 02 11:58:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Acquiring lock "cinder-329a8b6f-c574-455b-aa45-3c02b7258e9f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Lock "cinder-329a8b6f-c574-455b-aa45-3c02b7258e9f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Acquiring lock "cinder-quobyte-329a8b6f-c574-455b-aa45-3c02b7258e9f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Lock "cinder-quobyte-329a8b6f-c574-455b-aa45-3c02b7258e9f" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6e3bf-745c-45f8-ab0f-da5369825d78]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:17 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f Nov 02 11:58:17 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:18 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:18 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f Nov 02 11:58:18 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:18 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-329a8b6f-c574-455b-aa45-3c02b7258e9f" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Lock "cinder-quobyte-329a8b6f-c574-455b-aa45-3c02b7258e9f" released by "delete_volume" :: held 0.687s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Created reservations ['b3b94927-85a4-4b91-8851-b170da458820', '22be18d3-3b7f-4d20-9436-05f2b98a777c', 'f60b33a6-663a-4ba6-9cf1-5fa61cce4cd3', '799c8156-b5cb-457f-b9cf-15861fd8f6f4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:18 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:58:18 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:18 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:58:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Deleted volume successfully. Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-824d7e9a-c71b-433d-a16b-c37aa7756b2a tempest-VolumeImageDependencyTests-1026820325 None] Lock "cinder-329a8b6f-c574-455b-aa45-3c02b7258e9f-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:18 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:58:18 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:19 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:58:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:58:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:58:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Flow 'volume_create_manager' (85e55aaf-f27a-4613-abdd-5a734c73a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94777510-67f0-41e2-8609-156b536ee494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94777510-67f0-41e2-8609-156b536ee494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-94687695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8bf4c6-5125-4675-9980-6f2872745205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a15827ec4145dc9bd1fa4a7b55a2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0014749-db3f-4590-b560-612c818b4511,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:58:20Z,use_quota=True,user_id='c09c3d46f83b46fa86e1c366682eb516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfb59e5-a144-4f66-ab05-32d39f8dd9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfb59e5-a144-4f66-ab05-32d39f8dd9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa0a5e3-b414-4e49-95a4-0071654a1523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa0a5e3-b414-4e49-95a4-0071654a1523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df8bf4c6-5125-4675-9980-6f2872745205', 'volume_name': 'volume-df8bf4c6-5125-4675-9980-6f2872745205', 'volume_size': 1, 'snapshot_id': 'f0014749-db3f-4590-b560-612c818b4511'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b136a50b-ba6e-4474-8afe-b3e36f02243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b136a50b-ba6e-4474-8afe-b3e36f02243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2e10bb-4c32-42a2-9b3a-03141a8227e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Volume df8bf4c6-5125-4675-9980-6f2872745205: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df8bf4c6-5125-4675-9980-6f2872745205', 'volume_size': 1, 'snapshot_id': 'f0014749-db3f-4590-b560-612c818b4511'} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-quobyte-f0014749-db3f-4590-b560-612c818b4511-df8bf4c6-5125-4675-9980-6f2872745205" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-f0014749-db3f-4590-b560-612c818b4511-df8bf4c6-5125-4675-9980-6f2872745205" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Creating volume df8bf4c6-5125-4675-9980-6f2872745205 from snapshot f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-quobyte-df8bf4c6-5125-4675-9980-6f2872745205" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-df8bf4c6-5125-4675-9980-6f2872745205" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] snapshot: f0014749-db3f-4590-b560-612c818b4511, volume: df8bf4c6-5125-4675-9980-6f2872745205, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf80e8-fcd7-49ea-822d-285a436735ce]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:20 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 Nov 02 11:58:20 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:20 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511" returned: 0 in 0.430s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41554c1f-b7b8-4619-b14b-7231a376a3e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[897d1186-61f2-4ca9-a95e-ab0237910a72]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:21 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 Nov 02 11:58:21 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:21 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:58:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:58:21 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 11:58:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:21 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 Nov 02 11:58:21 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Flow 'volume_create_manager' (2e2af180-78ba-4b7f-9ddf-c09c17d0b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d597a3-01c0-4c9f-ba68-f498f01af1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d597a3-01c0-4c9f-ba68-f498f01af1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745751280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5762afe-9a38-434a-bea7-a77d1e45b53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d153b99a7cf148d0b80e4b8b74fee8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:58:25Z,use_quota=True,user_id='66f91c74bd184199b2a361c1cb355b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d583d4f-8e2a-4aac-8bde-4f1344f4e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d583d4f-8e2a-4aac-8bde-4f1344f4e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874ddb10-bf9d-4eaf-806d-dc7f9e49847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874ddb10-bf9d-4eaf-806d-dc7f9e49847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5762afe-9a38-434a-bea7-a77d1e45b53a', 'volume_name': 'volume-c5762afe-9a38-434a-bea7-a77d1e45b53a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb7682a-781c-4969-b02e-171e01873585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb7682a-781c-4969-b02e-171e01873585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d22b615-7e12-437c-9460-95c61137b440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Volume c5762afe-9a38-434a-bea7-a77d1e45b53a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5762afe-9a38-434a-bea7-a77d1e45b53a', 'volume_size': 1} Nov 02 11:58:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:31 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205" returned: 0 in 9.843s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1, size 1024.00 MB, duration 9.85 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 11:58:31 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Converted 1024.00 MB image at 104.01 MB/s Nov 02 11:58:31 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 is being set with open permissions: ugo+rw Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:31 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 Nov 02 11:58:31 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:31 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205" returned: 0 in 0.333s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-df8bf4c6-5125-4675-9980-6f2872745205" released by "_copy_volume_from_snapshot" :: held 11.168s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-f0014749-db3f-4590-b560-612c818b4511-df8bf4c6-5125-4675-9980-6f2872745205" released by "_create_volume_from_snapshot" :: held 11.264s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.281s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.103s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745751280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5762afe-9a38-434a-bea7-a77d1e45b53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d153b99a7cf148d0b80e4b8b74fee8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:58:25Z,use_quota=True,user_id='66f91c74bd184199b2a361c1cb355b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Creating volume c5762afe-9a38-434a-bea7-a77d1e45b53a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:58:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:31 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a 1073741824 Nov 02 11:58:31 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2e10bb-4c32-42a2-9b3a-03141a8227e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8bf4c6-5125-4675-9980-6f2872745205', 'volume_size': 1, 'snapshot_id': 'f0014749-db3f-4590-b560-612c818b4511'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68cc056-ac14-4e48-86f4-e2aca73c6162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Volume volume-df8bf4c6-5125-4675-9980-6f2872745205 (df8bf4c6-5125-4675-9980-6f2872745205): created successfully Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68cc056-ac14-4e48-86f4-e2aca73c6162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Flow 'volume_create_manager' (85e55aaf-f27a-4613-abdd-5a734c73a68a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0adc1e14-851d-4a9d-b483-28cd8fb0a1c8 tempest-TestStampPattern-1608186782 None] Created volume successfully. Nov 02 11:58:32 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a 1073741824" returned: 0 in 0.579s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:32 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a Nov 02 11:58:32 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:32 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d22b615-7e12-437c-9460-95c61137b440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5762afe-9a38-434a-bea7-a77d1e45b53a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cf13d0-ff8a-414e-8e60-498c7e27b35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Volume volume-c5762afe-9a38-434a-bea7-a77d1e45b53a (c5762afe-9a38-434a-bea7-a77d1e45b53a): created successfully Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cf13d0-ff8a-414e-8e60-498c7e27b35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Flow 'volume_create_manager' (2e2af180-78ba-4b7f-9ddf-c09c17d0b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-740625c5-77fa-4466-a9b8-a48f232280c5 tempest-ProjectReaderTests-1699497426 None] Created volume successfully. Nov 02 11:58:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Acquiring lock "cinder-c5762afe-9a38-434a-bea7-a77d1e45b53a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Lock "cinder-c5762afe-9a38-434a-bea7-a77d1e45b53a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Acquiring lock "cinder-quobyte-c5762afe-9a38-434a-bea7-a77d1e45b53a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Lock "cinder-quobyte-c5762afe-9a38-434a-bea7-a77d1e45b53a" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f57a8b-df08-482e-ae06-f29b891e6ce8]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:33 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a Nov 02 11:58:33 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:34 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a" returned: 0 in 0.452s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:34 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a Nov 02 11:58:34 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:34 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c5762afe-9a38-434a-bea7-a77d1e45b53a" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Lock "cinder-quobyte-c5762afe-9a38-434a-bea7-a77d1e45b53a" released by "delete_volume" :: held 0.786s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Created reservations ['adcea002-8cf1-49c3-b6d0-707830f38630', '1c0a23d5-f630-4d9c-9518-c65d79e55b93', '1724101e-4fce-4815-9196-5df3ae88a6ab', '627485b3-1dbf-4c0c-b8c2-f020b6353dc9'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:34 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:58:34 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:34 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:58:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Deleted volume successfully. Nov 02 11:58:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e5d24b03-6fda-4314-b03d-7d096047b72a tempest-ProjectReaderTests-1699497426 None] Lock "cinder-c5762afe-9a38-434a-bea7-a77d1e45b53a-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Flow 'volume_create_manager' (12cddee8-22d5-4e89-bf4b-d6cdbafd6d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b191670-390d-40e7-b52d-4702ede01b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b191670-390d-40e7-b52d-4702ede01b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975476789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b4b56f-9c4b-4f6a-9ed7-20b3174a7153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d153b99a7cf148d0b80e4b8b74fee8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:58:35Z,use_quota=True,user_id='66f91c74bd184199b2a361c1cb355b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6dd8e9-6a67-46b9-afcd-fe6e01903f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6dd8e9-6a67-46b9-afcd-fe6e01903f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa056a81-d278-4c4f-8beb-4d46095ed72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa056a81-d278-4c4f-8beb-4d46095ed72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b4b56f-9c4b-4f6a-9ed7-20b3174a7153', 'volume_name': 'volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478b2c5d-c6d0-478c-a293-777060ef9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478b2c5d-c6d0-478c-a293-777060ef9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a9b0ea-570a-4575-8ac6-aa5d72c2b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Volume 03b4b56f-9c4b-4f6a-9ed7-20b3174a7153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153', 'volume_size': 1} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975476789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b4b56f-9c4b-4f6a-9ed7-20b3174a7153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d153b99a7cf148d0b80e4b8b74fee8a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:58:35Z,use_quota=True,user_id='66f91c74bd184199b2a361c1cb355b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Creating volume 03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:58:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:35 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 1073741824 Nov 02 11:58:35 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:35 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 1073741824" returned: 0 in 0.497s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:35 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 Nov 02 11:58:35 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:36 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:58:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a9b0ea-570a-4575-8ac6-aa5d72c2b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cec711f-b0d9-46e7-8b56-6fe1b9535b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:58:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Volume volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 (03b4b56f-9c4b-4f6a-9ed7-20b3174a7153): created successfully Nov 02 11:58:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cec711f-b0d9-46e7-8b56-6fe1b9535b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:58:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Flow 'volume_create_manager' (12cddee8-22d5-4e89-bf4b-d6cdbafd6d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:58:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3e7c18f3-9cd8-4ced-be1b-4161cd5fe924 tempest-ProjectReaderTests-1699497426 None] Created volume successfully. Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Acquiring lock "cinder-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Lock "cinder-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Acquiring lock "cinder-quobyte-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Lock "cinder-quobyte-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6825571-d0ac-4efe-a8da-149ff868ac07]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:37 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 Nov 02 11:58:37 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:37 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:37 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153 Nov 02 11:58:37 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:38 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Lock "cinder-quobyte-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153" released by "delete_volume" :: held 0.664s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Created reservations ['c68383f9-5cd3-4610-b9bc-3c6316fa77b3', 'e5027861-0469-4aa9-9dc1-52cb9481b325', '383788f4-3708-4560-aed6-8b7d076bedcb', '69cd18aa-cc2f-426e-9b6e-facaf6cecf81'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:38 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:58:38 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:38 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:58:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Deleted volume successfully. Nov 02 11:58:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-94b92ee9-601d-416f-ae13-da112a825196 tempest-ProjectReaderTests-1699497426 None] Lock "cinder-03b4b56f-9c4b-4f6a-9ed7-20b3174a7153-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-2ef9bebb-8551-48c2-8f79-4cad0a2ff59d tempest-TestShelveInstance-1097247295 None] Terminate volume connection completed successfully. Nov 02 11:58:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-2ef9bebb-8551-48c2-8f79-4cad0a2ff59d tempest-TestShelveInstance-1097247295 None] Deleting attachment 3826df9b-32c6-4104-830b-ee8628e09c19. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:58:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Acquiring lock "cinder-95f14376-ab8f-409d-948c-c6fac6046cf4-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Lock "cinder-95f14376-ab8f-409d-948c-c6fac6046cf4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Acquiring lock "cinder-quobyte-95f14376-ab8f-409d-948c-c6fac6046cf4" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:58:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Lock "cinder-quobyte-95f14376-ab8f-409d-948c-c6fac6046cf4" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:58:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6edca16-e135-435d-b41a-b45150890a35]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:58:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:42 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 Nov 02 11:58:42 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:43 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4" returned: 0 in 0.514s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:43 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4 Nov 02 11:58:43 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:43 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95f14376-ab8f-409d-948c-c6fac6046cf4" returned: 0 in 0.365s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Lock "cinder-quobyte-95f14376-ab8f-409d-948c-c6fac6046cf4" released by "delete_volume" :: held 0.953s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG cinder.quota [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Created reservations ['8a135e70-1d22-4511-8ec0-6e9dff405089', '6882b1be-5bb3-4d6d-9c49-f826a47764c0', '705d7bab-6c4b-4d94-b32e-c0b716744836', '17f16408-a7f1-49c2-8012-103538431c57'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:58:43 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:58:43 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:58:44 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Nov 02 11:58:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.448s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:58:44 devstack cinder-volume[86846]: DEBUG cinder.manager [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:58:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Deleted volume successfully. Nov 02 11:58:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [req-dc6da9dd-5202-4e72-9599-35b7f57b34f6 req-78001ce0-7df6-4874-91cf-406b075a965b tempest-TestShelveInstance-1097247295 None] Lock "cinder-95f14376-ab8f-409d-948c-c6fac6046cf4-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:58:53 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=43,cinder:INSERT=20,cinder:UPDATE=41,cinder:DELETE=3 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:58:54 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=23,cinder:UPDATE=45,cinder:INSERT=7,cinder:DELETE=5 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:58:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7b81aee0-e6d7-455f-a6f3-0f17ea89b240 req-6d0cca62-05a1-43d7-b9e8-b38a8e0ca6a2 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:58:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7b81aee0-e6d7-455f-a6f3-0f17ea89b240 req-6d0cca62-05a1-43d7-b9e8-b38a8e0ca6a2 tempest-TestStampPattern-1608186782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:58:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [req-7b81aee0-e6d7-455f-a6f3-0f17ea89b240 req-6d0cca62-05a1-43d7-b9e8-b38a8e0ca6a2 tempest-TestStampPattern-1608186782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:58:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-7b81aee0-e6d7-455f-a6f3-0f17ea89b240 req-6d0cca62-05a1-43d7-b9e8-b38a8e0ca6a2 tempest-TestStampPattern-1608186782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf', 'name': 'volume-df8bf4c6-5125-4675-9980-6f2872745205', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26d17490-8a10-4910-b22f-ab4726e5066b', 'enforce_multipath': True} {{(pid=86846) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:58:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-7b81aee0-e6d7-455f-a6f3-0f17ea89b240 req-6d0cca62-05a1-43d7-b9e8-b38a8e0ca6a2 tempest-TestStampPattern-1608186782 None] attachment_update completed successfully. Nov 02 11:59:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [req-1328f6aa-4329-494f-890f-2f9bc588cad2 req-b3c3b2f4-5046-4958-87ab-55991eb6f423 tempest-TestStampPattern-1608186782 None] Terminate volume connection completed successfully. Nov 02 11:59:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [req-1328f6aa-4329-494f-890f-2f9bc588cad2 req-b3c3b2f4-5046-4958-87ab-55991eb6f423 tempest-TestStampPattern-1608186782 None] Deleting attachment 26d17490-8a10-4910-b22f-ab4726e5066b. {{(pid=86846) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-df8bf4c6-5125-4675-9980-6f2872745205-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Lock "cinder-df8bf4c6-5125-4675-9980-6f2872745205-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-quobyte-df8bf4c6-5125-4675-9980-6f2872745205" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-df8bf4c6-5125-4675-9980-6f2872745205" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f75096-4aca-4954-b763-3e6f82f88b08]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:05 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 Nov 02 11:59:05 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:05 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:05 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205 Nov 02 11:59:05 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:05 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-df8bf4c6-5125-4675-9980-6f2872745205" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-df8bf4c6-5125-4675-9980-6f2872745205" released by "delete_volume" :: held 0.633s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Created reservations ['6d7881b4-b5b6-436b-b97b-a3be922e28ed', '9dc147b9-fbae-49b8-957f-67557a36eee1', '526b6e56-eb79-4d76-b649-a20c96d99cbe', 'f5c54b6d-c7da-4792-b85e-57cd5adb67c8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:06 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:06 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:06 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.234s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Deleted volume successfully. Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-40b82b6a-3438-44fd-adc1-ea9d0a1ab0b9 tempest-TestStampPattern-1608186782 None] Lock "cinder-df8bf4c6-5125-4675-9980-6f2872745205-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-f0014749-db3f-4590-b560-612c818b4511-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Lock "cinder-f0014749-db3f-4590-b560-612c818b4511-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-quobyte-41554c1f-b7b8-4619-b14b-7231a376a3e1" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-41554c1f-b7b8-4619-b14b-7231a376a3e1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-quobyte-f0014749-db3f-4590-b560-612c818b4511" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-f0014749-db3f-4590-b560-612c818b4511" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Deleting offline snapshot f0014749-db3f-4590-b560-612c818b4511 of volume 41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] snapshot_file for this snap is: volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a88d8a3-5689-4591-ae2c-d19dbd0be905]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:06 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 Nov 02 11:59:06 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:07 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511" returned: 0 in 0.357s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41554c1f-b7b8-4619-b14b-7231a376a3e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[88969ff4-209f-40db-a50d-613ab31e1c8a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:07 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 Nov 02 11:59:07 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:07 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1" returned: 0 in 0.500s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:07 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 Nov 02 11:59:07 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:07 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:07 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511 Nov 02 11:59:07 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:08 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1.f0014749-db3f-4590-b560-612c818b4511" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-f0014749-db3f-4590-b560-612c818b4511" released by "_delete_snapshot" :: held 1.540s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-41554c1f-b7b8-4619-b14b-7231a376a3e1" released by "delete_snapshot" :: held 1.562s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:08 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Created reservations ['66c978e9-52b7-40de-9e5a-9f4ec6d7ceb1', '5a32f1f9-de58-4f56-8366-e87b345ca534', 'd73407df-27c1-4afa-8ffe-f9c5a6580500', 'b7964f0d-2bcf-444c-94af-5ee0553d53f2'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Delete snapshot completed successfully. Nov 02 11:59:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd5d61f2-bf51-4c56-b127-c028a240a670 tempest-TestStampPattern-1608186782 None] Lock "cinder-f0014749-db3f-4590-b560-612c818b4511-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-41554c1f-b7b8-4619-b14b-7231a376a3e1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Lock "cinder-41554c1f-b7b8-4619-b14b-7231a376a3e1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Acquiring lock "cinder-quobyte-41554c1f-b7b8-4619-b14b-7231a376a3e1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-41554c1f-b7b8-4619-b14b-7231a376a3e1" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e6db4-a45d-446c-9f50-07ffc0dcecd9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:12 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 Nov 02 11:59:12 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:12 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1" returned: 0 in 0.351s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:12 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1 Nov 02 11:59:12 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:12 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-41554c1f-b7b8-4619-b14b-7231a376a3e1" returned: 0 in 0.239s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Lock "cinder-quobyte-41554c1f-b7b8-4619-b14b-7231a376a3e1" released by "delete_volume" :: held 0.655s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Created reservations ['3e320c00-5f0f-4186-a88d-03ecfe4baa30', '4d601b65-7792-4a0a-8af1-aee12b6adc9d', 'c18aa83f-72b8-451c-b10b-0e74169c105c', '165808fc-c8c3-44ac-b4f4-9bff3c72c02a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:12 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:12 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:13 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:13 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Deleted volume successfully. Nov 02 11:59:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdd4ce91-d3e0-4d63-b260-0173ae9910a8 tempest-TestStampPattern-1608186782 None] Lock "cinder-41554c1f-b7b8-4619-b14b-7231a376a3e1-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:59:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:18 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:18 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:19 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.275s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:59:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:59:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:59:22 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:59:23 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (4446b1c5-da7a-4ef6-99b2-a3690a64a8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47365f43-86d9-4290-b0e0-30c232c49fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47365f43-86d9-4290-b0e0-30c232c49fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826030686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d3c6c8-7afb-42a3-b526-2c00469ef9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:25Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2bd0fe-cb2f-4986-a986-80556b0e0f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2bd0fe-cb2f-4986-a986-80556b0e0f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab51342d-1e3e-4be2-9882-23e939093390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab51342d-1e3e-4be2-9882-23e939093390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d3c6c8-7afb-42a3-b526-2c00469ef9fb', 'volume_name': 'volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81990d18-0e8f-47eb-95b4-b9b68d782d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81990d18-0e8f-47eb-95b4-b9b68d782d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a5a989-ca20-44e5-9ae9-c4b94c45d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Volume 03d3c6c8-7afb-42a3-b526-2c00469ef9fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb', 'volume_size': 1} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826030686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d3c6c8-7afb-42a3-b526-2c00469ef9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:25Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Creating volume 03d3c6c8-7afb-42a3-b526-2c00469ef9fb {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:24 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:24 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb 1073741824 Nov 02 11:59:24 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (34ac5ff8-a9fd-4603-89b5-179de9ee59e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45318d1b-de39-429f-a950-fd96f22fe234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45318d1b-de39-429f-a950-fd96f22fe234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233910100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:25Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bd7109-4d3d-49a3-8775-ec01370920f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bd7109-4d3d-49a3-8775-ec01370920f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a4e2ce-b90f-404a-8538-40284231239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a4e2ce-b90f-404a-8538-40284231239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f', 'volume_name': 'volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd27696-d831-4f2b-b1fc-5c8352811675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd27696-d831-4f2b-b1fc-5c8352811675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c92659-9692-429f-85b8-468ef3e7c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Volume 55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f', 'volume_size': 1} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:25 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb 1073741824" returned: 0 in 0.493s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:25 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb Nov 02 11:59:25 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (673d2e8e-aab0-4482-bc88-e10a0c55820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734888f1-210b-46b5-b072-c118de302dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734888f1-210b-46b5-b072-c118de302dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1746417918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064c0611-066f-4072-901a-222ffc6c740a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:25Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2956c9-200b-4b7a-a529-e26014ec37d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2956c9-200b-4b7a-a529-e26014ec37d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0538c19-0f2d-49a3-81b6-4afdcfd0fb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0538c19-0f2d-49a3-81b6-4afdcfd0fb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064c0611-066f-4072-901a-222ffc6c740a', 'volume_name': 'volume-064c0611-066f-4072-901a-222ffc6c740a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5de567-002c-4a2d-8b3b-b9271411a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5de567-002c-4a2d-8b3b-b9271411a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf9049a-0396-430b-a6e4-7bee00d087f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Volume 064c0611-066f-4072-901a-222ffc6c740a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064c0611-066f-4072-901a-222ffc6c740a', 'volume_size': 1} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:25 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233910100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:25Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Creating volume 55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:25 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:25 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f 1073741824 Nov 02 11:59:25 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a5a989-ca20-44e5-9ae9-c4b94c45d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78e3b60-c3e3-4f4e-a532-3bd761073c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Volume volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb (03d3c6c8-7afb-42a3-b526-2c00469ef9fb): created successfully Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78e3b60-c3e3-4f4e-a532-3bd761073c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (4446b1c5-da7a-4ef6-99b2-a3690a64a8fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9650eac3-8824-4538-9833-f097743edbf9 tempest-CreateVolumesFromImageTest-1965279148 None] Created volume successfully. Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (fd374be5-2301-434e-bc3d-ee4e6d1bf052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7709b7a6-16b8-401a-bba1-6824759bc06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7709b7a6-16b8-401a-bba1-6824759bc06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1126939422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a721256b-4a81-41ea-9c11-f8d0d2e843f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:26Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e2021e-21ee-4099-b232-c831c651c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e2021e-21ee-4099-b232-c831c651c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8823ce-b173-45cf-8bcd-d9f76fd507a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8823ce-b173-45cf-8bcd-d9f76fd507a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a721256b-4a81-41ea-9c11-f8d0d2e843f2', 'volume_name': 'volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1141f25f-fb86-4ca4-aa7f-dd33d864d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1141f25f-fb86-4ca4-aa7f-dd33d864d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61de1e9-8fb9-40f8-a47d-a5a0ea18ea7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:25 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Volume a721256b-4a81-41ea-9c11-f8d0d2e843f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2', 'volume_size': 1} Nov 02 11:59:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:26 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f 1073741824" returned: 0 in 0.518s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:26 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f Nov 02 11:59:26 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (b922f9ef-290d-4f10-99aa-3c2628b3c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1ba2e7-6f4c-41af-bffe-4c2342680564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1ba2e7-6f4c-41af-bffe-4c2342680564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837577160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e49047-6824-4183-b527-8c1b6949a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:26Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e25004-b704-4d3f-8ff1-ff7ff4a349cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e25004-b704-4d3f-8ff1-ff7ff4a349cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a40a4-21a1-4cbb-91b6-70142d83e975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a40a4-21a1-4cbb-91b6-70142d83e975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e49047-6824-4183-b527-8c1b6949a396', 'volume_name': 'volume-01e49047-6824-4183-b527-8c1b6949a396', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640307aa-37d5-49db-8c00-c6058dc6f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640307aa-37d5-49db-8c00-c6058dc6f790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5fc784-94fa-424b-a3c5-270073ec4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Volume 01e49047-6824-4183-b527-8c1b6949a396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e49047-6824-4183-b527-8c1b6949a396', 'volume_size': 1} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:26 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f" returned: 0 in 0.241s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1746417918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064c0611-066f-4072-901a-222ffc6c740a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:25Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Creating volume 064c0611-066f-4072-901a-222ffc6c740a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:26 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c92659-9692-429f-85b8-468ef3e7c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:26 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a 1073741824 Nov 02 11:59:26 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6783440-d205-4c4d-93a4-b1a3eb4b5308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:26 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Volume volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f (55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f): created successfully Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6783440-d205-4c4d-93a4-b1a3eb4b5308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (34ac5ff8-a9fd-4603-89b5-179de9ee59e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:26 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ad5e70a2-b9fb-4fc0-a6e3-f68099c07e9f tempest-CreateVolumesFromImageTest-1965279148 None] Created volume successfully. Nov 02 11:59:26 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a 1073741824" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:26 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a Nov 02 11:59:26 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:27 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1126939422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a721256b-4a81-41ea-9c11-f8d0d2e843f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:26Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Creating volume a721256b-4a81-41ea-9c11-f8d0d2e843f2 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:27 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf9049a-0396-430b-a6e4-7bee00d087f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064c0611-066f-4072-901a-222ffc6c740a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:27 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 1073741824 Nov 02 11:59:27 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55b7eb3-1968-42d9-ba14-fd41ddd89e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Volume volume-064c0611-066f-4072-901a-222ffc6c740a (064c0611-066f-4072-901a-222ffc6c740a): created successfully Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55b7eb3-1968-42d9-ba14-fd41ddd89e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (673d2e8e-aab0-4482-bc88-e10a0c55820f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eec8d51c-3a4d-48fe-a75a-abdf3183d122 tempest-CreateVolumesFromImageTest-1965279148 None] Created volume successfully. Nov 02 11:59:27 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 1073741824" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:27 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 Nov 02 11:59:27 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:27 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2" returned: 0 in 0.235s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837577160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e49047-6824-4183-b527-8c1b6949a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b4449a93e4da4a0288fe63f60b268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:26Z,use_quota=True,user_id='5191101a55db4279aef59ff02712feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Creating volume 01e49047-6824-4183-b527-8c1b6949a396 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:27 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61de1e9-8fb9-40f8-a47d-a5a0ea18ea7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:27 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 1073741824 Nov 02 11:59:27 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe4b27d-0295-4d69-8e87-a0692fd06986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:27 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Volume volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 (a721256b-4a81-41ea-9c11-f8d0d2e843f2): created successfully Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe4b27d-0295-4d69-8e87-a0692fd06986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:27 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (fd374be5-2301-434e-bc3d-ee4e6d1bf052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:27 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bc4ce035-bd6d-4316-94a1-1f1728b2aa79 tempest-CreateVolumesFromImageTest-1965279148 None] Created volume successfully. Nov 02 11:59:28 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 1073741824" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:28 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 Nov 02 11:59:28 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:28 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5fc784-94fa-424b-a3c5-270073ec4402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e49047-6824-4183-b527-8c1b6949a396', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3ce8ea-eb7a-4d56-92e4-3b85b97caa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Volume volume-01e49047-6824-4183-b527-8c1b6949a396 (01e49047-6824-4183-b527-8c1b6949a396): created successfully Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3ce8ea-eb7a-4d56-92e4-3b85b97caa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Flow 'volume_create_manager' (b922f9ef-290d-4f10-99aa-3c2628b3c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9a66cb28-6b0a-4131-bdfe-c9961bee0529 tempest-CreateVolumesFromImageTest-1965279148 None] Created volume successfully. Nov 02 11:59:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-01e49047-6824-4183-b527-8c1b6949a396-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-01e49047-6824-4183-b527-8c1b6949a396-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-quobyte-01e49047-6824-4183-b527-8c1b6949a396" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-01e49047-6824-4183-b527-8c1b6949a396" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe358af2-01c0-411d-b0b0-13b226657ab6]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:29 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 Nov 02 11:59:29 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:30 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:30 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396 Nov 02 11:59:30 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:30 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-01e49047-6824-4183-b527-8c1b6949a396" returned: 0 in 0.233s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-01e49047-6824-4183-b527-8c1b6949a396" released by "delete_volume" :: held 0.626s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Created reservations ['0d782073-33c4-4e07-a14c-dfa3bc0eb123', '13c12253-e21a-4547-a701-7cb088c8278a', '019eabd0-5d30-4018-a811-c37c384b9771', '9cd72858-1d5e-41d8-94b4-79d6a14d0247'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:30 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:30 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:30 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Deleted volume successfully. Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7aec3df1-e7da-4b40-8ffc-b16f1da8a4a2 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-01e49047-6824-4183-b527-8c1b6949a396-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-a721256b-4a81-41ea-9c11-f8d0d2e843f2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-a721256b-4a81-41ea-9c11-f8d0d2e843f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-quobyte-a721256b-4a81-41ea-9c11-f8d0d2e843f2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-a721256b-4a81-41ea-9c11-f8d0d2e843f2" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb14a470-14b7-49d0-a880-256294c45b95]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:30 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 Nov 02 11:59:30 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:31 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2" returned: 0 in 0.351s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:31 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2 Nov 02 11:59:31 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:31 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a721256b-4a81-41ea-9c11-f8d0d2e843f2" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-a721256b-4a81-41ea-9c11-f8d0d2e843f2" released by "delete_volume" :: held 0.640s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Created reservations ['92eeac39-9d68-46ff-b5dc-c63acf061f61', 'dcad55d3-f65e-48ab-a876-a1fc3cf6598f', '81c467ae-9d37-4123-956d-9b922f1b559b', '3ae3ca4a-b5ea-43e2-832e-5104d0376009'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:31 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:31 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:31 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Deleted volume successfully. Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9831c30f-816c-4480-9079-649d236cb31f tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-a721256b-4a81-41ea-9c11-f8d0d2e843f2-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-064c0611-066f-4072-901a-222ffc6c740a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-064c0611-066f-4072-901a-222ffc6c740a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-quobyte-064c0611-066f-4072-901a-222ffc6c740a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-064c0611-066f-4072-901a-222ffc6c740a" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb31300-8b38-4796-8fdb-bf31fd25a398]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:32 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a Nov 02 11:59:32 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:32 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:32 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a Nov 02 11:59:32 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:32 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-064c0611-066f-4072-901a-222ffc6c740a" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-064c0611-066f-4072-901a-222ffc6c740a" released by "delete_volume" :: held 0.607s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Created reservations ['791b94e4-7ca0-4bab-8aae-03ce84ba83ee', '0316b890-90d7-427c-896e-3d11fb92a448', '98adff96-5ba9-4f39-96f1-369ee24e9802', '546a7f9e-3032-4edc-9fab-0e3b51ffcb76'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:32 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:32 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:32 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.230s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Deleted volume successfully. Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c61f3aa4-57c5-4277-87c9-7fe206618ed3 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-064c0611-066f-4072-901a-222ffc6c740a-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-quobyte-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c35268-861f-4cc0-bf26-16219bd363f9]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:33 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f Nov 02 11:59:33 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:33 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:33 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f Nov 02 11:59:33 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:33 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f" released by "delete_volume" :: held 0.637s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:33 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Created reservations ['78e6a354-bd6a-46e9-acb6-2f1f78fd8425', 'bc329034-c38b-4290-a207-5bfd3968b4be', '2c7c0b78-470b-4e0b-984c-a45b341bc019', 'ce07f3ad-2501-4b89-b020-263b947ba980'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:34 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:34 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:34 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Deleted volume successfully. Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-03d3c6c8-7afb-42a3-b526-2c00469ef9fb-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ca5b00ba-6da3-4599-b55a-81dc95470a93 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-55d9b5b0-5af1-4c4f-894e-3dfb61e4ab5f-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-03d3c6c8-7afb-42a3-b526-2c00469ef9fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "cinder-quobyte-03d3c6c8-7afb-42a3-b526-2c00469ef9fb" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-03d3c6c8-7afb-42a3-b526-2c00469ef9fb" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[14283813-2143-47b2-9c85-b5ca1972a2a7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:34 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb Nov 02 11:59:34 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:34 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:34 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb Nov 02 11:59:34 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:34 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-03d3c6c8-7afb-42a3-b526-2c00469ef9fb" returned: 0 in 0.230s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-quobyte-03d3c6c8-7afb-42a3-b526-2c00469ef9fb" released by "delete_volume" :: held 0.610s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Created reservations ['3a2083dd-77b9-4ad2-854d-d366832095f6', 'eb8782dd-e354-41a3-88ce-3c2223eb0c81', '5afbbc96-ca76-4746-a89b-f87d15a693f2', 'ba23e2bb-9dc9-435f-ae43-82900abc7a44'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:35 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:35 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:35 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Deleted volume successfully. Nov 02 11:59:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-7cc6acf3-e121-4d60-8e1d-4522f0723c72 tempest-CreateVolumesFromImageTest-1965279148 None] Lock "cinder-03d3c6c8-7afb-42a3-b526-2c00469ef9fb-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (a81beba2-cc2d-4760-bb1b-96fa60b0c15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5e91f4-2caa-41c5-8584-2f6050987520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5e91f4-2caa-41c5-8584-2f6050987520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722668403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c45d7f-9b5d-4e9c-b199-18a72fbbbe68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:38Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffa6320-beed-44b6-a34e-a72bf07df932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffa6320-beed-44b6-a34e-a72bf07df932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e62a4a-7ba0-4463-bb42-a7b5e479c61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e62a4a-7ba0-4463-bb42-a7b5e479c61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c45d7f-9b5d-4e9c-b199-18a72fbbbe68', 'volume_name': 'volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6136f491-b1f0-40b2-a798-6fce36f99772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6136f491-b1f0-40b2-a798-6fce36f99772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f01122-4ded-49b5-81fd-7cd75c3b7e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume 79c45d7f-9b5d-4e9c-b199-18a72fbbbe68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68', 'volume_size': 1} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722668403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c45d7f-9b5d-4e9c-b199-18a72fbbbe68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:38Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Creating volume 79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:38 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:38 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 1073741824 Nov 02 11:59:38 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:38 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 1073741824" returned: 0 in 0.420s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:38 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 Nov 02 11:59:38 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:38 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" returned: 0 in 0.239s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f01122-4ded-49b5-81fd-7cd75c3b7e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30faf86-cc3d-4575-bc5d-b899c7e29d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 (79c45d7f-9b5d-4e9c-b199-18a72fbbbe68): created successfully Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30faf86-cc3d-4575-bc5d-b899c7e29d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (a81beba2-cc2d-4760-bb1b-96fa60b0c15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-39724dcb-052e-46e2-98b8-00e0ebf76253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created volume successfully. Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Creating offline snapshot 701381b5-8025-4640-ac30-a0ba3fd3dcf5 of volume 79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[36631163-a281-4638-a10e-24bb2adb5d90]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:39 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 Nov 02 11:59:39 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:39 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:39 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 1G Nov 02 11:59:39 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:39 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 1G" returned: 0 in 0.385s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:39 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 Nov 02 11:59:39 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:40 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 is being set with open permissions: ugo+rw Nov 02 11:59:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:40 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 Nov 02 11:59:40 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:40 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5" returned: 0 in 0.226s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:40 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.info Nov 02 11:59:40 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:40 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.info" returned: 0 in 0.238s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.info is being set with open permissions: ugo+rw Nov 02 11:59:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:40 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.info Nov 02 11:59:40 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:40 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.info" returned: 0 in 0.233s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a63b2eab-326a-46b9-b436-b0ecf6d6db6f tempest-CreateVolumesFromSnapshotTest-926243714 None] Create snapshot completed successfully Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (c6012bf4-6b51-4660-b80b-4a4e71bbb4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17161fca-3796-4e30-b772-7e3389fd42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17161fca-3796-4e30-b772-7e3389fd42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531320172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd951649-b381-4cd8-9655-5aea7bf214fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:42Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4c98df-8e6a-4c4d-a864-414dc9edce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4c98df-8e6a-4c4d-a864-414dc9edce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d23e84-ff47-4b15-82aa-cace409b31c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d23e84-ff47-4b15-82aa-cace409b31c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd951649-b381-4cd8-9655-5aea7bf214fd', 'volume_name': 'volume-dd951649-b381-4cd8-9655-5aea7bf214fd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a069954-c82a-473b-b9d2-24f10d720451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a069954-c82a-473b-b9d2-24f10d720451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8dde18-061d-403e-b843-51c08c3df9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume dd951649-b381-4cd8-9655-5aea7bf214fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd951649-b381-4cd8-9655-5aea7bf214fd', 'volume_size': 1} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531320172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd951649-b381-4cd8-9655-5aea7bf214fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:42Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Creating volume dd951649-b381-4cd8-9655-5aea7bf214fd {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:41 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd 1073741824 Nov 02 11:59:41 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (8b7f2b15-c952-459e-8772-bc0709b73ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7efeac-c295-4eba-885d-3775e0c066a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7efeac-c295-4eba-885d-3775e0c066a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551032785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:42Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744f3a3b-8c84-4cdf-b26f-cf50165e552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744f3a3b-8c84-4cdf-b26f-cf50165e552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fd5c15-15c5-4a05-9c9c-e5cf481a6722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fd5c15-15c5-4a05-9c9c-e5cf481a6722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24b89c9-ea46-4c5f-a36b-fc831ae8bb1c', 'volume_name': 'volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b5b2a4-302d-405d-aec4-1d9cbfe808ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b5b2a4-302d-405d-aec4-1d9cbfe808ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58e966d-49f3-4396-963f-f03b700c9692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c', 'volume_size': 1} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:42 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd 1073741824" returned: 0 in 0.484s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:42 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd Nov 02 11:59:42 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (f59cd38f-f595-4d34-9131-47f14dd13431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846cf616-e834-4c82-a232-afafe485de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846cf616-e834-4c82-a232-afafe485de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93062377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1056ac19-ac68-4a4d-b6fd-8ddd5980fba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:42Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0983f5b-0846-4375-841d-1aa3ee897e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0983f5b-0846-4375-841d-1aa3ee897e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81bb3cb-e53a-4927-897d-5189dd9cb033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81bb3cb-e53a-4927-897d-5189dd9cb033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1056ac19-ac68-4a4d-b6fd-8ddd5980fba7', 'volume_name': 'volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef133a9-1dde-4fde-b0f5-e35fd418fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef133a9-1dde-4fde-b0f5-e35fd418fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afca0cc9-dc01-440c-9335-a5595e35477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume 1056ac19-ac68-4a4d-b6fd-8ddd5980fba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7', 'volume_size': 1} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:42 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd" returned: 0 in 0.285s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551032785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:42Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Creating volume d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:42 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8dde18-061d-403e-b843-51c08c3df9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd951649-b381-4cd8-9655-5aea7bf214fd', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c 1073741824 Nov 02 11:59:42 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cc4368-ebd5-4ff5-a2b7-8c08c9c8ffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume volume-dd951649-b381-4cd8-9655-5aea7bf214fd (dd951649-b381-4cd8-9655-5aea7bf214fd): created successfully Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cc4368-ebd5-4ff5-a2b7-8c08c9c8ffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (c6012bf4-6b51-4660-b80b-4a4e71bbb4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-88b23bf6-e64e-4f9d-853d-95c98414f253 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created volume successfully. Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (ea116d1a-0250-47e9-8ab3-83c2356e23ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d59f4b2-c9b1-4eb7-907a-9cbbb006b6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d59f4b2-c9b1-4eb7-907a-9cbbb006b6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-123511614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:43Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dcfb3d-9f1d-4d5e-974e-5a560ce96475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dcfb3d-9f1d-4d5e-974e-5a560ce96475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549e3de4-32dd-45e6-9ca8-abb01ffcf8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549e3de4-32dd-45e6-9ca8-abb01ffcf8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c', 'volume_name': 'volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42190a74-e1a7-4bdc-b09d-63e27d357353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42190a74-e1a7-4bdc-b09d-63e27d357353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f95d078-f278-4012-950d-3ab3893ace44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c', 'volume_size': 1} Nov 02 11:59:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:43 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c 1073741824" returned: 0 in 0.546s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (a25d3eb6-a99e-4f6f-8c87-9b61e7b47264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cb057b-955c-489b-b2de-8c4931b361c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cb057b-955c-489b-b2de-8c4931b361c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722719873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489788f6-7bef-4f2a-80aa-44a433c5c2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:43Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624cb5dd-a91b-409b-b76a-89a5c3195cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624cb5dd-a91b-409b-b76a-89a5c3195cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d4ffd-add7-4868-a1f4-8440f39da22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d4ffd-add7-4868-a1f4-8440f39da22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489788f6-7bef-4f2a-80aa-44a433c5c2bc', 'volume_name': 'volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b07d59e-8ac6-44b9-94d7-9fcdbd0b324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b07d59e-8ac6-44b9-94d7-9fcdbd0b324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ff789c-fb61-4e02-aad7-0649ecd265a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume 489788f6-7bef-4f2a-80aa-44a433c5c2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc', 'volume_size': 1} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:43 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c Nov 02 11:59:43 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:43 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93062377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1056ac19-ac68-4a4d-b6fd-8ddd5980fba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:42Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Creating volume 1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:43 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:43 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 1073741824 Nov 02 11:59:43 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58e966d-49f3-4396-963f-f03b700c9692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87272cf4-a1e0-412d-bf58-6d1f6ebf3212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c (d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c): created successfully Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87272cf4-a1e0-412d-bf58-6d1f6ebf3212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (8b7f2b15-c952-459e-8772-bc0709b73ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-34aeb809-8a3a-4969-ba41-0d518c0973fe tempest-CreateVolumesFromSnapshotTest-926243714 None] Created volume successfully. Nov 02 11:59:44 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 1073741824" returned: 0 in 0.430s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:44 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 Nov 02 11:59:44 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:44 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-123511614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:43Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Creating volume b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afca0cc9-dc01-440c-9335-a5595e35477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:44 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c 1073741824 Nov 02 11:59:44 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58b253d-6ed6-47cd-bdd2-40c06fc7b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 (1056ac19-ac68-4a4d-b6fd-8ddd5980fba7): created successfully Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58b253d-6ed6-47cd-bdd2-40c06fc7b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (f59cd38f-f595-4d34-9131-47f14dd13431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ca31de91-4d22-4c26-a73b-90920904075b tempest-CreateVolumesFromSnapshotTest-926243714 None] Created volume successfully. Nov 02 11:59:44 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c 1073741824" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:44 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c Nov 02 11:59:44 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:44 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c" returned: 0 in 0.238s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722719873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489788f6-7bef-4f2a-80aa-44a433c5c2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1837dc20d843aebab7fec98bdf1deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:43Z,use_quota=True,user_id='96875c6f60e047beaadca675d2141596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Creating volume 489788f6-7bef-4f2a-80aa-44a433c5c2bc {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:44 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:45 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc 1073741824 Nov 02 11:59:45 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f95d078-f278-4012-950d-3ab3893ace44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9f8d32-5807-4b24-9118-ed078f7d59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c (b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c): created successfully Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9f8d32-5807-4b24-9118-ed078f7d59cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (ea116d1a-0250-47e9-8ab3-83c2356e23ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4618648f-2105-4c79-b71d-68f44e256851 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created volume successfully. Nov 02 11:59:45 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc 1073741824" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:45 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc Nov 02 11:59:45 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:45 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ff789c-fb61-4e02-aad7-0649ecd265a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a36f1-566d-4286-afab-10737e3b0988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Volume volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc (489788f6-7bef-4f2a-80aa-44a433c5c2bc): created successfully Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a36f1-566d-4286-afab-10737e3b0988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Flow 'volume_create_manager' (a25d3eb6-a99e-4f6f-8c87-9b61e7b47264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-525b2a3d-2c0a-4bba-bc13-772728c3d08f tempest-CreateVolumesFromSnapshotTest-926243714 None] Created volume successfully. Nov 02 11:59:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-489788f6-7bef-4f2a-80aa-44a433c5c2bc-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-489788f6-7bef-4f2a-80aa-44a433c5c2bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-489788f6-7bef-4f2a-80aa-44a433c5c2bc" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-489788f6-7bef-4f2a-80aa-44a433c5c2bc" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3375dc-bb50-443f-8999-4c11de29c410]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:46 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc Nov 02 11:59:46 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:46 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:47 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc Nov 02 11:59:47 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:47 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-489788f6-7bef-4f2a-80aa-44a433c5c2bc" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-489788f6-7bef-4f2a-80aa-44a433c5c2bc" released by "delete_volume" :: held 0.636s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created reservations ['36a70239-7189-4773-8321-96ff0a862c9b', '270aed68-3679-4c84-98d3-c85fd3581bef', '664d4aec-1603-429c-b847-05cfddded40f', '95ffffa9-dd60-428f-aea9-1a00ae5e889d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:47 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:47 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:47 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Deleted volume successfully. Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-82bd5ec5-8ccb-400c-8709-facffff9e6e2 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-489788f6-7bef-4f2a-80aa-44a433c5c2bc-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeec5f95-9a37-47fd-8f37-a9965c31abee]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:47 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c Nov 02 11:59:47 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:48 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:48 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c Nov 02 11:59:48 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:48 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c" released by "delete_volume" :: held 0.646s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created reservations ['71882aac-aab4-473f-a453-e9334f68c11c', 'cfc74318-d343-4707-b09f-1f73f10eda81', 'f48ebcff-86ce-46fe-9634-0699acbca4d9', 'f6fb9f4c-9021-4d80-8e41-44df1bc964f5'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:48 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:48 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:48 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.241s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Deleted volume successfully. Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de3d9283-830c-44df-a4bc-1d3046ab8785 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-b0e5c7dd-2beb-4e9f-ae9a-8b856ed7cb6c-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6496770a-66de-4fc2-bd2b-652c9c4ae383]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:49 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 Nov 02 11:59:49 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:49 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:49 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7 Nov 02 11:59:49 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:49 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7" returned: 0 in 0.230s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7" released by "delete_volume" :: held 0.609s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created reservations ['ddc8e997-c4e0-44e9-b262-879dc6a83754', '44031079-f2cb-4c9b-8bad-c597c46087e6', '37258454-140c-4243-ba7f-77c8d4eca416', '079a9806-8273-4a39-bbfb-3133b826905a'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:49 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:49 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:49 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.230s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Deleted volume successfully. Nov 02 11:59:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-de254f0b-15da-49b1-ae8e-9ed63378f186 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-1056ac19-ac68-4a4d-b6fd-8ddd5980fba7-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3b75d-0d88-498c-be50-cb14703430e1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:50 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c Nov 02 11:59:50 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:50 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c" returned: 0 in 0.343s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:50 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c Nov 02 11:59:50 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:50 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c" returned: 0 in 0.236s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c" released by "delete_volume" :: held 0.621s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created reservations ['4dd9ef6b-15e6-473d-bd6a-1b6a7e1fc19f', '7d9df0f7-4bce-4475-b1ed-afe887ee17c0', '71f9700c-4fa8-4b23-a6da-33552f3ad1af', '586b0604-b26b-4bae-91cc-8d80a8c4cd67'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:50 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:50 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:51 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Deleted volume successfully. Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-92a84e32-7b14-4d46-b07d-568e165f3ef1 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-d24b89c9-ea46-4c5f-a36b-fc831ae8bb1c-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-dd951649-b381-4cd8-9655-5aea7bf214fd-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-dd951649-b381-4cd8-9655-5aea7bf214fd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-dd951649-b381-4cd8-9655-5aea7bf214fd" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-dd951649-b381-4cd8-9655-5aea7bf214fd" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e2ac6c-cef6-4962-8582-c915d0630459]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:51 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd Nov 02 11:59:51 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:51 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:51 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd Nov 02 11:59:51 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:51 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dd951649-b381-4cd8-9655-5aea7bf214fd" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-dd951649-b381-4cd8-9655-5aea7bf214fd" released by "delete_volume" :: held 0.645s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created reservations ['643d9e71-1280-443a-be5a-0c098dd3ffb5', '6ba4138a-f6ca-43e9-ac49-5178c02bfeaa', '382d807a-d28d-498d-99e9-16627343d7df', '7cc0eb6e-ef2b-4ef4-83c6-0b3936134c9e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:52 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:52 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:52 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.230s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Deleted volume successfully. Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0b9c32c9-03f5-4ab0-ae22-deeadb0baeb5 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-dd951649-b381-4cd8-9655-5aea7bf214fd-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-701381b5-8025-4640-ac30-a0ba3fd3dcf5-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-701381b5-8025-4640-ac30-a0ba3fd3dcf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-701381b5-8025-4640-ac30-a0ba3fd3dcf5" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-701381b5-8025-4640-ac30-a0ba3fd3dcf5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Deleting offline snapshot 701381b5-8025-4640-ac30-a0ba3fd3dcf5 of volume 79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] snapshot_file for this snap is: volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afac5ee-7f5c-42ee-b99e-8b1580fdd00a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:52 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 Nov 02 11:59:52 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:52 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc3b359-f55f-4688-860a-e2a9ed3a374e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:52 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 Nov 02 11:59:52 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:53 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:53 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 Nov 02 11:59:53 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:53 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5" returned: 0 in 0.329s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:53 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5 Nov 02 11:59:53 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:53 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68.701381b5-8025-4640-ac30-a0ba3fd3dcf5" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-701381b5-8025-4640-ac30-a0ba3fd3dcf5" released by "_delete_snapshot" :: held 1.375s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" released by "delete_snapshot" :: held 1.397s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created reservations ['35f04a24-4816-4ae1-b776-4c60b7ca0cee', '6ba36aa0-551e-43b6-a5fe-2b844ed11df3', '5a4be67b-63a8-4b80-a78a-1232268c57ac', '7a32c668-7c8f-4087-894c-755c421db1e1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Delete snapshot completed successfully. Nov 02 11:59:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-57483334-31ab-44b6-a249-d280917e9572 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-701381b5-8025-4640-ac30-a0ba3fd3dcf5-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "cinder-quobyte-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c3db8c-d929-4fdb-9b00-71f4cbcd5ef7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:54 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 Nov 02 11:59:54 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:54 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:54 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68 Nov 02 11:59:54 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:55 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-quobyte-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68" released by "delete_volume" :: held 0.631s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Created reservations ['0d862f57-3da7-4a69-930a-635683a4226c', 'dce05bcb-d99e-47e2-89b4-0509b5248eb7', '9d0b0a63-e5ee-4d32-80d4-f02950bc62d6', 'e0770649-6491-4664-8f5e-401dbb436f48'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:55 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 11:59:55 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:55 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:59:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Deleted volume successfully. Nov 02 11:59:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fe1a65ef-7320-4365-982b-35ee9d8c8b56 tempest-CreateVolumesFromSnapshotTest-926243714 None] Lock "cinder-79c45d7f-9b5d-4e9c-b199-18a72fbbbe68-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Flow 'volume_create_manager' (7403294a-b11f-42af-9b69-c0a826114f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66ef3b3-0bfa-4e51-bec2-ba396da9d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66ef3b3-0bfa-4e51-bec2-ba396da9d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037dce85-1eff-4540-96f8-8cba511578d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed9f17ef5804d4c83455068d69affac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:58Z,use_quota=True,user_id='f80f6cbf61a8488cab377ca4aa6244b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13306a9-2906-4c50-8a4a-144fad0e21f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13306a9-2906-4c50-8a4a-144fad0e21f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2112e6d-bdc0-42a1-a851-3577a3d229de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2112e6d-bdc0-42a1-a851-3577a3d229de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037dce85-1eff-4540-96f8-8cba511578d9', 'volume_name': 'volume-037dce85-1eff-4540-96f8-8cba511578d9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ffd607-c70b-49e3-9fb3-e9e99392523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ffd607-c70b-49e3-9fb3-e9e99392523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b912fb14-b195-4b28-b5ea-3f44bd966333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Volume 037dce85-1eff-4540-96f8-8cba511578d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037dce85-1eff-4540-96f8-8cba511578d9', 'volume_size': 1} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037dce85-1eff-4540-96f8-8cba511578d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed9f17ef5804d4c83455068d69affac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:59:58Z,use_quota=True,user_id='f80f6cbf61a8488cab377ca4aa6244b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Creating volume 037dce85-1eff-4540-96f8-8cba511578d9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:58 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:58 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 1073741824 Nov 02 11:59:58 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:58 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 1073741824" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:58 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 Nov 02 11:59:58 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:59:58 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9" returned: 0 in 0.238s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b912fb14-b195-4b28-b5ea-3f44bd966333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037dce85-1eff-4540-96f8-8cba511578d9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84233ccc-7cdd-4759-a096-2edc7fa72417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Volume volume-037dce85-1eff-4540-96f8-8cba511578d9 (037dce85-1eff-4540-96f8-8cba511578d9): created successfully Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84233ccc-7cdd-4759-a096-2edc7fa72417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Flow 'volume_create_manager' (7403294a-b11f-42af-9b69-c0a826114f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-55b666f3-532b-4faf-afe6-62edb4a49315 tempest-CinderUnicodeTest-1411374935 None] Created volume successfully. Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Flow 'volume_create_manager' (ee3eed1a-0b63-487b-8f0a-6d1d68f3307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6b9b11-36e3-444a-9db4-f2c971fe439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6b9b11-36e3-444a-9db4-f2c971fe439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1035634986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5372e38-d24b-4abb-bc8c-1bcf3a370bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed9f17ef5804d4c83455068d69affac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:00Z,use_quota=True,user_id='f80f6cbf61a8488cab377ca4aa6244b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93164142-ef65-45be-8331-9485b1327a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93164142-ef65-45be-8331-9485b1327a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d146e44-9ed6-4775-9311-b7490bb333cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d146e44-9ed6-4775-9311-b7490bb333cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5372e38-d24b-4abb-bc8c-1bcf3a370bd8', 'volume_name': 'volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983768dc-b3d3-491b-9dca-93df05fffff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983768dc-b3d3-491b-9dca-93df05fffff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a2e71b-c488-4aa1-9bff-80ccd2cb2dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:59:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Volume d5372e38-d24b-4abb-bc8c-1bcf3a370bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8', 'volume_size': 1} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:59:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1035634986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5372e38-d24b-4abb-bc8c-1bcf3a370bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ed9f17ef5804d4c83455068d69affac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:00Z,use_quota=True,user_id='f80f6cbf61a8488cab377ca4aa6244b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Creating volume d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:59:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 11:59:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:59:59 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 1073741824 Nov 02 11:59:59 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:00 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 1073741824" returned: 0 in 0.396s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:00 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 Nov 02 12:00:00 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:00 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a2e71b-c488-4aa1-9bff-80ccd2cb2dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd9f625-799b-41d7-9dc2-f922cdd20cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Volume volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 (d5372e38-d24b-4abb-bc8c-1bcf3a370bd8): created successfully Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd9f625-799b-41d7-9dc2-f922cdd20cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Flow 'volume_create_manager' (ee3eed1a-0b63-487b-8f0a-6d1d68f3307a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9b2d22bc-8e72-4add-bf24-aa8ae8ce2d6f tempest-CinderUnicodeTest-1411374935 None] Created volume successfully. Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Creating offline snapshot 13078af1-cc00-42cc-9655-76e37e69ba38 of volume d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083d77b-16b6-4443-a4ce-b78ab4ab32be]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:01 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 Nov 02 12:00:01 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:01 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:01 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 1G Nov 02 12:00:01 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:01 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 1G" returned: 0 in 0.371s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:01 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 Nov 02 12:00:01 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:01 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38" returned: 0 in 0.288s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:01 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 is being set with open permissions: ugo+rw Nov 02 12:00:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:01 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 Nov 02 12:00:01 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:02 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38" returned: 0 in 0.234s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:02 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.info Nov 02 12:00:02 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:02 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.info" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:02 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.info is being set with open permissions: ugo+rw Nov 02 12:00:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:02 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.info Nov 02 12:00:02 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:02 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.info" returned: 0 in 0.225s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-05cc8dc8-1451-47fa-9170-d3c3de8908cd tempest-CinderUnicodeTest-1411374935 None] Create snapshot completed successfully Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "cinder-13078af1-cc00-42cc-9655-76e37e69ba38-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-13078af1-cc00-42cc-9655-76e37e69ba38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "cinder-quobyte-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "cinder-quobyte-13078af1-cc00-42cc-9655-76e37e69ba38" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-13078af1-cc00-42cc-9655-76e37e69ba38" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Deleting offline snapshot 13078af1-cc00-42cc-9655-76e37e69ba38 of volume d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] snapshot_file for this snap is: volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66d6fe-6cca-4a7d-b3b1-75c1f66e65b1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:03 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 Nov 02 12:00:03 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:03 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e227660-3e96-4845-9ccc-c49dc9fef121]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:03 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 Nov 02 12:00:03 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:03 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:03 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 Nov 02 12:00:03 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:04 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:04 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38 Nov 02 12:00:04 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:04 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8.13078af1-cc00-42cc-9655-76e37e69ba38" returned: 0 in 0.230s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-13078af1-cc00-42cc-9655-76e37e69ba38" released by "_delete_snapshot" :: held 1.349s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" released by "delete_snapshot" :: held 1.369s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Created reservations ['9c8fbf61-1132-490f-abff-b6d75f445960', '40f8a1d1-c821-4617-8c28-6b28e3286dd7', '0b38155c-6cbd-464e-a499-04b8003854d8', '79749d52-a2fd-402b-8545-f6ecae39d7d3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Delete snapshot completed successfully. Nov 02 12:00:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-15c2c75a-ec27-4b8f-ba35-3c13653ffc78 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-13078af1-cc00-42cc-9655-76e37e69ba38-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "cinder-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "cinder-quobyte-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a317c113-2c22-4f95-a8b8-5baf4c23127f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:05 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 Nov 02 12:00:05 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:05 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:05 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8 Nov 02 12:00:05 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:05 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" returned: 0 in 0.250s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8" released by "delete_volume" :: held 0.658s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:05 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Created reservations ['cd3f9461-8cec-4379-bfcb-6ecdd67e9ce7', '62797ccf-b317-479f-886c-c2e9d054fead', '95c5e1db-14a8-40cd-9642-35a6e812d82f', 'd9a53918-af85-45ae-8f55-873e5d80cdfd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:06 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:06 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:06 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Deleted volume successfully. Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6eab44fc-6be5-46db-ab99-7a8efdfdfd7c tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-d5372e38-d24b-4abb-bc8c-1bcf3a370bd8-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "cinder-037dce85-1eff-4540-96f8-8cba511578d9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-037dce85-1eff-4540-96f8-8cba511578d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "cinder-quobyte-037dce85-1eff-4540-96f8-8cba511578d9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-037dce85-1eff-4540-96f8-8cba511578d9" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8dc605-e32a-43d2-82e2-64e78c20260f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:06 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 Nov 02 12:00:06 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:06 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9" returned: 0 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:06 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9 Nov 02 12:00:06 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:07 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-037dce85-1eff-4540-96f8-8cba511578d9" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-quobyte-037dce85-1eff-4540-96f8-8cba511578d9" released by "delete_volume" :: held 0.668s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Created reservations ['cd5c8b22-35c3-4ac6-830a-4ddbe9867862', '9d1c7593-84f9-4f62-aca5-206bbc154b62', '386849f4-8d0b-4e3c-8ad2-6707d7b9780c', 'f196ba98-b81b-4594-a6b8-34356a76be46'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:07 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:07 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:07 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.265s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Deleted volume successfully. Nov 02 12:00:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-540e4fdb-27cb-4a44-be5c-fa4972043b35 tempest-CinderUnicodeTest-1411374935 None] Lock "cinder-037dce85-1eff-4540-96f8-8cba511578d9-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (b6e410cf-53d1-4188-aa83-77a37e766b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375ec28a-a3af-405d-9353-2256e8f93eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375ec28a-a3af-405d-9353-2256e8f93eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929297466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87506062-bf29-4de4-8fb9-bfa852b7bac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:15Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d287c2-12cf-4c14-b154-d12d522d1a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d287c2-12cf-4c14-b154-d12d522d1a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e75037b-9574-4b2e-823c-19629f82602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e75037b-9574-4b2e-823c-19629f82602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87506062-bf29-4de4-8fb9-bfa852b7bac2', 'volume_name': 'volume-87506062-bf29-4de4-8fb9-bfa852b7bac2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0ee728-65e5-4cf3-ac9e-8b9372ff75ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0ee728-65e5-4cf3-ac9e-8b9372ff75ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7861418-79de-4ccd-ac70-7b67fc06f3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Volume 87506062-bf29-4de4-8fb9-bfa852b7bac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87506062-bf29-4de4-8fb9-bfa852b7bac2', 'volume_size': 1} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929297466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87506062-bf29-4de4-8fb9-bfa852b7bac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:15Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Creating volume 87506062-bf29-4de4-8fb9-bfa852b7bac2 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:15 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 1073741824 Nov 02 12:00:15 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:15 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 1073741824" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:15 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 Nov 02 12:00:15 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:15 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2" returned: 0 in 0.249s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7861418-79de-4ccd-ac70-7b67fc06f3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87506062-bf29-4de4-8fb9-bfa852b7bac2', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25b8f70-0375-4a4c-bfff-a710c8a7fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Volume volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 (87506062-bf29-4de4-8fb9-bfa852b7bac2): created successfully Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25b8f70-0375-4a4c-bfff-a710c8a7fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (b6e410cf-53d1-4188-aa83-77a37e766b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-50803b9b-b160-4c65-9c33-1e37796105ae tempest-ProjectReaderTests-2109856195 None] Created volume successfully. Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-87506062-bf29-4de4-8fb9-bfa852b7bac2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Lock "cinder-87506062-bf29-4de4-8fb9-bfa852b7bac2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-quobyte-87506062-bf29-4de4-8fb9-bfa852b7bac2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-87506062-bf29-4de4-8fb9-bfa852b7bac2" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[775da8ff-8a09-4020-ae2b-8045dd4d26d4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:16 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 Nov 02 12:00:16 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:16 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:16 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2 Nov 02 12:00:16 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:16 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-87506062-bf29-4de4-8fb9-bfa852b7bac2" returned: 0 in 0.246s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-87506062-bf29-4de4-8fb9-bfa852b7bac2" released by "delete_volume" :: held 0.648s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Created reservations ['4ac6405e-56e7-47ad-9b53-2148c1e3d52a', '8bb2a730-424e-47bf-bfb1-e8a86261726d', '5c9f6cf3-0740-4329-a06a-4810b1d9a7d4', '056397ef-72e9-4c97-9f7b-0b769dfd4579'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:17 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:17 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:17 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Deleted volume successfully. Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-db1d544b-94a1-4dba-82e7-3387a673fefe tempest-ProjectReaderTests-2109856195 None] Lock "cinder-87506062-bf29-4de4-8fb9-bfa852b7bac2-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (85ffd9c2-411e-4111-aaff-b67dfa73bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad19d00-9f84-4c07-946f-babbd1bddf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad19d00-9f84-4c07-946f-babbd1bddf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505543857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1988f3-ad06-4a5c-b72e-7732e17320c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:18Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac7245b-ed65-4430-a38e-8e49534ac583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac7245b-ed65-4430-a38e-8e49534ac583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde93ee4-cf61-4786-a5c8-48729390aa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde93ee4-cf61-4786-a5c8-48729390aa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1988f3-ad06-4a5c-b72e-7732e17320c5', 'volume_name': 'volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecc4111-261b-4e01-8904-26f95cf6b416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecc4111-261b-4e01-8904-26f95cf6b416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad47c8e-ab35-46a9-98e6-be2d3ad03655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:17 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Volume 5b1988f3-ad06-4a5c-b72e-7732e17320c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5', 'volume_size': 1} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505543857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1988f3-ad06-4a5c-b72e-7732e17320c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:18Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Creating volume 5b1988f3-ad06-4a5c-b72e-7732e17320c5 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:17 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:17 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 1073741824 Nov 02 12:00:17 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:18 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 1073741824" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:18 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 Nov 02 12:00:18 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:18 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad47c8e-ab35-46a9-98e6-be2d3ad03655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713f99d-8afb-4fef-8c51-c66ef7e83853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:18 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Volume volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 (5b1988f3-ad06-4a5c-b72e-7732e17320c5): created successfully Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713f99d-8afb-4fef-8c51-c66ef7e83853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (85ffd9c2-411e-4111-aaff-b67dfa73bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-acf43bb8-154d-46f1-96e3-54ac13971bc5 tempest-ProjectReaderTests-2109856195 None] Created volume successfully. Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-5b1988f3-ad06-4a5c-b72e-7732e17320c5-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Lock "cinder-5b1988f3-ad06-4a5c-b72e-7732e17320c5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:18 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:18 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-quobyte-5b1988f3-ad06-4a5c-b72e-7732e17320c5" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-5b1988f3-ad06-4a5c-b72e-7732e17320c5" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea78a859-5fb0-4dc9-ba6b-eb845cd67960]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:19 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 Nov 02 12:00:19 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:19 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.262s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:00:19 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:19 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5 Nov 02 12:00:19 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:19 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-5b1988f3-ad06-4a5c-b72e-7732e17320c5" returned: 0 in 0.248s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-5b1988f3-ad06-4a5c-b72e-7732e17320c5" released by "delete_volume" :: held 0.651s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Created reservations ['d0f6c713-1c47-4835-bd79-644a0db88a75', 'ba6cfd45-2f27-4033-bcf4-127d4733b81c', '53e5194e-39e3-4415-bb7d-94b0086c0ceb', 'a75bb6f8-6c31-465e-93da-554b2f5d4140'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:19 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:19 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:20 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.257s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Deleted volume successfully. Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb85f3d3-b33a-4545-be81-98ab0224263d tempest-ProjectReaderTests-2109856195 None] Lock "cinder-5b1988f3-ad06-4a5c-b72e-7732e17320c5-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (eda1f9ce-ecf1-4f6f-9f80-15ba374e45cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8107bace-f6d4-4fcc-8e0b-1607968dabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8107bace-f6d4-4fcc-8e0b-1607968dabc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103355514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2aff83-986a-4667-a3bc-26cb05d5d8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:21Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11424053-a234-4ec8-b18f-afc815cf2010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11424053-a234-4ec8-b18f-afc815cf2010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab29de48-287e-4941-b6e6-44cd9da5ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab29de48-287e-4941-b6e6-44cd9da5ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2aff83-986a-4667-a3bc-26cb05d5d8d1', 'volume_name': 'volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf93ab-fd5b-4efc-bc99-35d703e522be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf93ab-fd5b-4efc-bc99-35d703e522be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c17640-95e1-4898-b6e7-8c97d6cf9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:20 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Volume 3b2aff83-986a-4667-a3bc-26cb05d5d8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1', 'volume_size': 1} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103355514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2aff83-986a-4667-a3bc-26cb05d5d8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:21Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Creating volume 3b2aff83-986a-4667-a3bc-26cb05d5d8d1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:20 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:20 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 1073741824 Nov 02 12:00:20 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:21 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 1073741824" returned: 0 in 0.427s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:21 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 Nov 02 12:00:21 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:21 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1" returned: 0 in 0.257s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c17640-95e1-4898-b6e7-8c97d6cf9567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998be756-22f1-4ffe-a366-88524b5fe2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:21 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Volume volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 (3b2aff83-986a-4667-a3bc-26cb05d5d8d1): created successfully Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998be756-22f1-4ffe-a366-88524b5fe2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (eda1f9ce-ecf1-4f6f-9f80-15ba374e45cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:21 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d8e422be-4700-4f11-9055-c63735ab0b87 tempest-ProjectReaderTests-2109856195 None] Created volume successfully. Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-3b2aff83-986a-4667-a3bc-26cb05d5d8d1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-3b2aff83-986a-4667-a3bc-26cb05d5d8d1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-quobyte-3b2aff83-986a-4667-a3bc-26cb05d5d8d1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-3b2aff83-986a-4667-a3bc-26cb05d5d8d1" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333cdaf-68d9-49d2-8909-0eb04e47b9ea]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:21 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 Nov 02 12:00:21 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:22 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:22 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1 Nov 02 12:00:22 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:22 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-3b2aff83-986a-4667-a3bc-26cb05d5d8d1" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-3b2aff83-986a-4667-a3bc-26cb05d5d8d1" released by "delete_volume" :: held 0.657s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Created reservations ['59ab5f53-2333-43ec-84d5-0e4b536cbbc7', 'dadfb30f-4d7b-4a38-9179-2b28b56f00bb', '95c7df3b-d26e-420d-bff1-e1c43ca1223a', '247bbb1d-d8e2-453d-8cc1-1e864d1355e5'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:22 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:22 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:22 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.265s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Deleted volume successfully. Nov 02 12:00:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ed29a72b-3380-4416-a12a-cd85804ef3a5 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-3b2aff83-986a-4667-a3bc-26cb05d5d8d1-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=133,cinder:INSERT=43,cinder:UPDATE=199,cinder:DELETE=11 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=183,cinder:SELECT=129,cinder:DELETE=23,cinder:INSERT=47 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (139e4461-e33d-4991-8f40-569dc9e0d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adaa8606-292d-4e7c-a9ec-4b754f7dfa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adaa8606-292d-4e7c-a9ec-4b754f7dfa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490576219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac08b4a-9a17-41de-9c47-46bd8b78e684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:23Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b3182-f112-4c46-a464-f23aa42f1808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b3182-f112-4c46-a464-f23aa42f1808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afdd972-38f2-4dac-87c6-3a7d1231ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afdd972-38f2-4dac-87c6-3a7d1231ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac08b4a-9a17-41de-9c47-46bd8b78e684', 'volume_name': 'volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc3b1bc-fdf8-45a0-a50a-6f1ed708b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc3b1bc-fdf8-45a0-a50a-6f1ed708b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f25a99-e36b-4ac2-bf18-8329e9f7c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Volume 7ac08b4a-9a17-41de-9c47-46bd8b78e684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684', 'volume_size': 1} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1490576219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac08b4a-9a17-41de-9c47-46bd8b78e684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94cbc266f1b458dbc18189d12edf172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:23Z,use_quota=True,user_id='6abdb6ff877948e3910381805be8f250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Creating volume 7ac08b4a-9a17-41de-9c47-46bd8b78e684 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:23 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 1073741824 Nov 02 12:00:23 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:23 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 1073741824" returned: 0 in 0.422s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:23 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 Nov 02 12:00:23 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:24 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f25a99-e36b-4ac2-bf18-8329e9f7c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ae72a8-8152-4fb3-a65f-174a2c0c0f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:24 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Volume volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 (7ac08b4a-9a17-41de-9c47-46bd8b78e684): created successfully Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ae72a8-8152-4fb3-a65f-174a2c0c0f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Flow 'volume_create_manager' (139e4461-e33d-4991-8f40-569dc9e0d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3a10c5e3-3d11-4717-989b-e69f774de278 tempest-ProjectReaderTests-2109856195 None] Created volume successfully. Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-7ac08b4a-9a17-41de-9c47-46bd8b78e684-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-7ac08b4a-9a17-41de-9c47-46bd8b78e684-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "cinder-quobyte-7ac08b4a-9a17-41de-9c47-46bd8b78e684" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-7ac08b4a-9a17-41de-9c47-46bd8b78e684" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbc6c56-228c-4123-afe3-aeede94dfa06]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:24 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 Nov 02 12:00:24 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:24 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:24 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684 Nov 02 12:00:24 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:25 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7ac08b4a-9a17-41de-9c47-46bd8b78e684" returned: 0 in 0.241s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-quobyte-7ac08b4a-9a17-41de-9c47-46bd8b78e684" released by "delete_volume" :: held 0.631s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Created reservations ['71828de4-8797-406f-8cc8-28b66cb3ab24', '2215677a-f7e5-4464-80a2-ba9edd09a30e', '66a5c143-b570-49e5-be00-56c4f4366997', 'c121f6ab-d437-4c12-a4a5-3f1aa4ebc9dc'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:25 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:25 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:25 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.234s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Deleted volume successfully. Nov 02 12:00:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5abff900-4823-45ba-bfc4-212c5c783903 tempest-ProjectReaderTests-2109856195 None] Lock "cinder-7ac08b4a-9a17-41de-9c47-46bd8b78e684-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:35 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:00:35 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=2,cinder:SELECT=6 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (3d05a21c-62e1-408f-8993-e1e00d5ee5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c698a2ec-f083-482d-83a4-ab9996521d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c698a2ec-f083-482d-83a4-ab9996521d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248625740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d15e03-b957-42da-9089-1ea43918645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:37Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a35e79-b558-44c6-b8d7-469346a66bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a35e79-b558-44c6-b8d7-469346a66bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a18ddb-e067-404f-b87f-716ea2371312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a18ddb-e067-404f-b87f-716ea2371312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d15e03-b957-42da-9089-1ea43918645d', 'volume_name': 'volume-d8d15e03-b957-42da-9089-1ea43918645d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1380f45-d7a3-45d8-889f-62ca87134b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1380f45-d7a3-45d8-889f-62ca87134b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915ec358-8ad0-45ab-be60-f785c15a0265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume d8d15e03-b957-42da-9089-1ea43918645d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d15e03-b957-42da-9089-1ea43918645d', 'volume_size': 1} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248625740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d15e03-b957-42da-9089-1ea43918645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:37Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Creating volume d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:37 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:37 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d 1073741824 Nov 02 12:00:37 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (53f77617-4be7-4499-9d3b-74fd942082da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a295580-1ca5-4f99-ab72-2b4b4c2985c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a295580-1ca5-4f99-ab72-2b4b4c2985c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-548974449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f193454-bc7a-4d2c-a86b-f099e65d6349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:37Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bb2bfb-200f-43b8-97fe-0c43fba188c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bb2bfb-200f-43b8-97fe-0c43fba188c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090dc10b-9ace-4560-b80e-01532be259a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090dc10b-9ace-4560-b80e-01532be259a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f193454-bc7a-4d2c-a86b-f099e65d6349', 'volume_name': 'volume-6f193454-bc7a-4d2c-a86b-f099e65d6349', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519545f2-9c1c-4348-9fca-a35f274cef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519545f2-9c1c-4348-9fca-a35f274cef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560d7f0b-505f-41e3-bb5c-39aa467ff660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume 6f193454-bc7a-4d2c-a86b-f099e65d6349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f193454-bc7a-4d2c-a86b-f099e65d6349', 'volume_size': 1} Nov 02 12:00:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (674c0a30-98f4-4f7f-bb66-0a0e121a83e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ae8537-b2e7-4107-a2f7-83c081590c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d 1073741824" returned: 0 in 0.629s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ae8537-b2e7-4107-a2f7-83c081590c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747880786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddbc50c-f521-473b-82c7-e89e468f2348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:38Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf5073c-9e2a-40ca-93e8-53d4b3654021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf5073c-9e2a-40ca-93e8-53d4b3654021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b95fa6-aba5-4139-9f1f-178c3d8b4294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b95fa6-aba5-4139-9f1f-178c3d8b4294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddbc50c-f521-473b-82c7-e89e468f2348', 'volume_name': 'volume-4ddbc50c-f521-473b-82c7-e89e468f2348', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba71f72a-94e8-4e92-b1e2-b3d47d026127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba71f72a-94e8-4e92-b1e2-b3d47d026127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e91839a-de14-4399-b53c-0b9461347fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Volume 4ddbc50c-f521-473b-82c7-e89e468f2348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddbc50c-f521-473b-82c7-e89e468f2348', 'volume_size': 1} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:38 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d Nov 02 12:00:38 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (4ac4e94e-ecf5-47ba-840e-f24b34234c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce6aa2c-8164-421d-a18f-c9425b9f0e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce6aa2c-8164-421d-a18f-c9425b9f0e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873331016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40627edc-3ac9-4dd6-b8bc-754d29fe347d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:38Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db56f60-8a15-459e-9ae0-a1d3492681d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db56f60-8a15-459e-9ae0-a1d3492681d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b14776-64f4-4e31-95a2-b9bfa4deaca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b14776-64f4-4e31-95a2-b9bfa4deaca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40627edc-3ac9-4dd6-b8bc-754d29fe347d', 'volume_name': 'volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7309266-d60e-4e4c-a81b-b7e137a87e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7309266-d60e-4e4c-a81b-b7e137a87e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcee7f3-12df-45e6-a895-ffc5fac061bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Volume 40627edc-3ac9-4dd6-b8bc-754d29fe347d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d', 'volume_size': 1} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-548974449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f193454-bc7a-4d2c-a86b-f099e65d6349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:37Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Creating volume 6f193454-bc7a-4d2c-a86b-f099e65d6349 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:38 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:38 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 1073741824 Nov 02 12:00:38 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915ec358-8ad0-45ab-be60-f785c15a0265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d15e03-b957-42da-9089-1ea43918645d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba58963-03d1-48a4-8f20-4ef4644dc55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume volume-d8d15e03-b957-42da-9089-1ea43918645d (d8d15e03-b957-42da-9089-1ea43918645d): created successfully Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba58963-03d1-48a4-8f20-4ef4644dc55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (3d05a21c-62e1-408f-8993-e1e00d5ee5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eb381611-8bf6-4630-a822-a31414bc2218 tempest-CreateVolumesFromSnapshotTest-670914979 None] Created volume successfully. Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (1db9be23-123e-422b-a25f-8593066508e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a06d33-5530-4697-a665-9536e13f1c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a06d33-5530-4697-a665-9536e13f1c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350236830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677e95a0-711b-463f-9fcc-bd0bc1887f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:39Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe298f2-0690-4e6d-b66f-1bd592d82061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe298f2-0690-4e6d-b66f-1bd592d82061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d433d5-88c3-4698-ae11-e02477e24068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d433d5-88c3-4698-ae11-e02477e24068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677e95a0-711b-463f-9fcc-bd0bc1887f3a', 'volume_name': 'volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235ca419-2900-45a5-8b3a-1902ad8c0737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235ca419-2900-45a5-8b3a-1902ad8c0737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f09909-8dd3-440d-979e-e588e3a6db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:38 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Volume 677e95a0-711b-463f-9fcc-bd0bc1887f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a', 'volume_size': 1} Nov 02 12:00:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:39 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (841a76a6-293b-4375-ac21-3216aa1b8a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d2d752-3ad7-45b6-b633-7beed83cf1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 1073741824" returned: 0 in 0.656s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d2d752-3ad7-45b6-b633-7beed83cf1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653173825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c81d35f-9d80-4521-a4ac-d4753eece932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:39Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f8a667-dc64-4c7e-9e72-fcc358c6f826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f8a667-dc64-4c7e-9e72-fcc358c6f826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b999ba-2ed7-4a84-9051-842e4753c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b999ba-2ed7-4a84-9051-842e4753c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c81d35f-9d80-4521-a4ac-d4753eece932', 'volume_name': 'volume-6c81d35f-9d80-4521-a4ac-d4753eece932', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ec7228-32b6-4e3f-b98e-1756d6dace80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ec7228-32b6-4e3f-b98e-1756d6dace80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64e4200-70c6-42c4-8ba8-60ede47fb473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Volume 6c81d35f-9d80-4521-a4ac-d4753eece932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c81d35f-9d80-4521-a4ac-d4753eece932', 'volume_size': 1} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:39 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 Nov 02 12:00:39 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:39 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (d2ba5969-6bc1-45c8-9a75-e415cf2ce3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff17538-cea2-4ac2-8131-c6f9a11b9b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747880786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddbc50c-f521-473b-82c7-e89e468f2348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:38Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Creating volume 4ddbc50c-f521-473b-82c7-e89e468f2348 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:39 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff17538-cea2-4ac2-8131-c6f9a11b9b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329153354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c075bdb9-fb9a-42fb-8f02-2e5fa4da2027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:40Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e29e238-3e05-4d71-94a7-da7bfb30bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 1073741824 Nov 02 12:00:39 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e29e238-3e05-4d71-94a7-da7bfb30bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bacf1b-f76b-4947-abef-a0cdc1279a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bacf1b-f76b-4947-abef-a0cdc1279a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c075bdb9-fb9a-42fb-8f02-2e5fa4da2027', 'volume_name': 'volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bad79bf-4300-460d-9d84-6486bd8619da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bad79bf-4300-460d-9d84-6486bd8619da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6da39c2-00dd-4b27-b05a-c887aa578e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Volume c075bdb9-fb9a-42fb-8f02-2e5fa4da2027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027', 'volume_size': 1} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560d7f0b-505f-41e3-bb5c-39aa467ff660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f193454-bc7a-4d2c-a86b-f099e65d6349', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946adfbf-d332-46c7-9606-2e5b0eb2a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:39 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 (6f193454-bc7a-4d2c-a86b-f099e65d6349): created successfully Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946adfbf-d332-46c7-9606-2e5b0eb2a153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (53f77617-4be7-4499-9d3b-74fd942082da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ec44bbee-e568-4064-8d92-a598a5919f51 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created volume successfully. Nov 02 12:00:40 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 1073741824" returned: 0 in 0.451s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:40 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 Nov 02 12:00:40 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:40 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873331016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40627edc-3ac9-4dd6-b8bc-754d29fe347d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:38Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Creating volume 40627edc-3ac9-4dd6-b8bc-754d29fe347d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:40 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:40 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d 1073741824 Nov 02 12:00:40 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e91839a-de14-4399-b53c-0b9461347fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddbc50c-f521-473b-82c7-e89e468f2348', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd32e240-6987-47e8-88ff-c6b954951931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:40 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Volume volume-4ddbc50c-f521-473b-82c7-e89e468f2348 (4ddbc50c-f521-473b-82c7-e89e468f2348): created successfully Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd32e240-6987-47e8-88ff-c6b954951931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (674c0a30-98f4-4f7f-bb66-0a0e121a83e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6fbdb154-4b42-4259-9945-7a07a7396c12 tempest-CreateVolumesFromImageTest-450068903 None] Created volume successfully. Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (ac787073-ed6e-4cd3-a47f-f0a61d2f42e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbdce6-f1d7-40c9-8995-5e5698130a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbdce6-f1d7-40c9-8995-5e5698130a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610333053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad9e7d5-2402-4603-8d1c-549d0239b729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:41Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3cbcac-fb6e-409a-b27d-2aa6025f9b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3cbcac-fb6e-409a-b27d-2aa6025f9b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04418d1d-c97f-44bf-8281-04722ca7221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04418d1d-c97f-44bf-8281-04722ca7221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad9e7d5-2402-4603-8d1c-549d0239b729', 'volume_name': 'volume-fad9e7d5-2402-4603-8d1c-549d0239b729', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c985883a-7f70-4af1-a9f5-73012e1e1b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c985883a-7f70-4af1-a9f5-73012e1e1b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af476ae0-5dd8-40ea-8aac-b9994e10ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume fad9e7d5-2402-4603-8d1c-549d0239b729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad9e7d5-2402-4603-8d1c-549d0239b729', 'volume_size': 1} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:41 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d 1073741824" returned: 0 in 0.617s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:41 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d Nov 02 12:00:41 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (4a748df2-e367-4bcf-a15a-8709eafb1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932a4d8c-4fdf-4034-93b8-40f81210883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932a4d8c-4fdf-4034-93b8-40f81210883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367336222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e713702b-5783-45fb-b39d-d189dcc5f5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:41Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfb59df-bbd2-4111-b94a-88b308733374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfb59df-bbd2-4111-b94a-88b308733374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d56ef1-8573-4f79-b69a-f3c99a534851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d56ef1-8573-4f79-b69a-f3c99a534851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e713702b-5783-45fb-b39d-d189dcc5f5c6', 'volume_name': 'volume-e713702b-5783-45fb-b39d-d189dcc5f5c6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f96f5c-281e-4889-87e2-cfd8b7074516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f96f5c-281e-4889-87e2-cfd8b7074516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa51a328-2e41-49a0-8e38-c397282b3225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume e713702b-5783-45fb-b39d-d189dcc5f5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e713702b-5783-45fb-b39d-d189dcc5f5c6', 'volume_size': 1} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.705s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350236830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677e95a0-711b-463f-9fcc-bd0bc1887f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:39Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Creating volume 677e95a0-711b-463f-9fcc-bd0bc1887f3a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcee7f3-12df-45e6-a895-ffc5fac061bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd8fe09-5c3c-46bd-9a0a-41f4d848f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:41 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a 1073741824 Nov 02 12:00:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Volume volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d (40627edc-3ac9-4dd6-b8bc-754d29fe347d): created successfully Nov 02 12:00:41 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd8fe09-5c3c-46bd-9a0a-41f4d848f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (4ac4e94e-ecf5-47ba-840e-f24b34234c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6fdc1571-f277-43e7-be0f-3e5c20589fe3 tempest-CreateVolumesFromImageTest-450068903 None] Created volume successfully. Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (4562336c-37a1-459c-a7ff-a29862eb235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a4b6d9-e57c-4cc0-a0cc-c12b6db97403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a4b6d9-e57c-4cc0-a0cc-c12b6db97403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791070088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2eaad7-9fa7-487e-b53f-714e7d3656c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:42Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6857f108-147a-4bd5-8ce9-e1383fceb033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6857f108-147a-4bd5-8ce9-e1383fceb033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ae41f4-327e-47c3-8f70-be4abb895117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ae41f4-327e-47c3-8f70-be4abb895117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2eaad7-9fa7-487e-b53f-714e7d3656c0', 'volume_name': 'volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8d9296-e1f7-466f-afd3-795b0974f4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8d9296-e1f7-466f-afd3-795b0974f4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3420be51-73df-46f0-97ad-f2be6037d95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume 6f2eaad7-9fa7-487e-b53f-714e7d3656c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0', 'volume_size': 1} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Flow 'volume_create_manager' (60e09850-3d6b-4afb-88a5-0c1be00de14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc333d52-a473-4284-8a7d-4681c546d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc333d52-a473-4284-8a7d-4681c546d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3160454-55df-47d1-a82b-1586b7c8be10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdadcbe32394d10ab74480a5dea75c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:42Z,use_quota=True,user_id='a0ee8e89f914450990bef5dac09c31f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40d1d0ce-b5b3-47b9-96da-ea92df0601c2),volume_type_id=40d1d0ce-b5b3-47b9-96da-ea92df0601c2)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db9b651-52af-425d-84c9-8046d9d42b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db9b651-52af-425d-84c9-8046d9d42b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badc84d3-c6e9-436b-a6ba-7d244da21ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:00:42 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a 1073741824" returned: 0 in 0.786s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:42 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a Nov 02 12:00:42 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (2426a424-92da-4608-b508-f5cf57947dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f07939b-6999-4371-82a8-23de3c5a4225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f07939b-6999-4371-82a8-23de3c5a4225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1447142350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7576dd75-6fe0-4174-a937-7fef51d403f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:43Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32034a8-9455-406d-8c58-369d22b3ba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32034a8-9455-406d-8c58-369d22b3ba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee50f49e-a4af-4c5f-8dab-e5b947b41708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee50f49e-a4af-4c5f-8dab-e5b947b41708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7576dd75-6fe0-4174-a937-7fef51d403f7', 'volume_name': 'volume-7576dd75-6fe0-4174-a937-7fef51d403f7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378a6b24-b75f-4b13-b6e6-5bc795462d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378a6b24-b75f-4b13-b6e6-5bc795462d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602c74f1-b5bc-4607-bab3-0cbb5c46b3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume 7576dd75-6fe0-4174-a937-7fef51d403f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7576dd75-6fe0-4174-a937-7fef51d403f7', 'volume_size': 1} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:42 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badc84d3-c6e9-436b-a6ba-7d244da21ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3160454-55df-47d1-a82b-1586b7c8be10', 'volume_name': 'volume-b3160454-55df-47d1-a82b-1586b7c8be10', 'volume_size': 1, 'image_id': '8f5ccadc-22ba-4102-b6eb-7302146301fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f5ccadc-22ba-4102-b6eb-7302146301fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af1ced6895140292da637897e2ad4fdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fdadcbe32394d10ab74480a5dea75c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '373a261fcb91c505821454140bb658511bc6572d2531e15edd0122aa98f6f75d15cb7c6ab8b853fd110abea7db933215e63093535a10526d75f99b32ad6aa0c3', 'id': '8f5ccadc-22ba-4102-b6eb-7302146301fa', 'created_at': datetime.datetime(2026, 11, 2, 11, 0, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 0, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f5ccadc-22ba-4102-b6eb-7302146301fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd7e854-ef19-4086-a473-8b475f39eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd7e854-ef19-4086-a473-8b475f39eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfd19a7-fff8-481a-b1ca-0031d8d28750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Volume b3160454-55df-47d1-a82b-1586b7c8be10: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3160454-55df-47d1-a82b-1586b7c8be10', 'volume_size': 1, 'image_id': '8f5ccadc-22ba-4102-b6eb-7302146301fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f5ccadc-22ba-4102-b6eb-7302146301fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af1ced6895140292da637897e2ad4fdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fdadcbe32394d10ab74480a5dea75c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '373a261fcb91c505821454140bb658511bc6572d2531e15edd0122aa98f6f75d15cb7c6ab8b853fd110abea7db933215e63093535a10526d75f99b32ad6aa0c3', 'id': '8f5ccadc-22ba-4102-b6eb-7302146301fa', 'created_at': datetime.datetime(2026, 11, 2, 11, 0, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 0, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f5ccadc-22ba-4102-b6eb-7302146301fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Trying to clone b3160454-55df-47d1-a82b-1586b7c8be10 from image 8f5ccadc-22ba-4102-b6eb-7302146301fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f5ccadc-22ba-4102-b6eb-7302146301fa', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.532s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653173825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c81d35f-9d80-4521-a4ac-d4753eece932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:39Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Creating volume 6c81d35f-9d80-4521-a4ac-d4753eece932 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:42 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:42 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 1073741824 Nov 02 12:00:42 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f09909-8dd3-440d-979e-e588e3a6db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b916b1-bc3f-4888-a820-6f50bddf91dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Volume volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a (677e95a0-711b-463f-9fcc-bd0bc1887f3a): created successfully Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b916b1-bc3f-4888-a820-6f50bddf91dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (1db9be23-123e-422b-a25f-8593066508e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:00:43 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:00:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0302dc08-a3cd-4a4e-ae29-f345ddb9fdb1 tempest-CreateVolumesFromImageTest-450068903 None] Created volume successfully. Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (a5898d4d-da0d-4583-9f43-0880cac35155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafa9cb6-abe8-44c0-b320-a92fa7fc4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafa9cb6-abe8-44c0-b320-a92fa7fc4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113889605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6ac763-eeb1-499f-9566-b8179c2d8026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:43Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da10114-667a-4dbb-a893-a590e6d20b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da10114-667a-4dbb-a893-a590e6d20b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf48343-120d-42da-86bf-b3e0440ee814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf48343-120d-42da-86bf-b3e0440ee814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6ac763-eeb1-499f-9566-b8179c2d8026', 'volume_name': 'volume-ca6ac763-eeb1-499f-9566-b8179c2d8026', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bba099e-1060-4a11-bc62-dec036feffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bba099e-1060-4a11-bc62-dec036feffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7a93f7-78b0-4399-937f-86754157b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume ca6ac763-eeb1-499f-9566-b8179c2d8026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6ac763-eeb1-499f-9566-b8179c2d8026', 'volume_size': 1} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8491a0d2-2a35-4c72-b415-3f7276a43a26]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:43 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD Nov 02 12:00:43 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:43 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 1073741824" returned: 0 in 0.556s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:43 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 Nov 02 12:00:43 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:43 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:43 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD Nov 02 12:00:43 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:43 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.866s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329153354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c075bdb9-fb9a-42fb-8f02-2e5fa4da2027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a2ef5ccf614b26b5dfc8099f2caf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:40Z,use_quota=True,user_id='440fdab20cdf4b479ca500c9d9e4e17f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Creating volume c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:43 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:43 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 1073741824 Nov 02 12:00:43 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64e4200-70c6-42c4-8ba8-60ede47fb473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c81d35f-9d80-4521-a4ac-d4753eece932', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd049af4-140a-462b-a0e9-957f422da840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Volume volume-6c81d35f-9d80-4521-a4ac-d4753eece932 (6c81d35f-9d80-4521-a4ac-d4753eece932): created successfully Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd049af4-140a-462b-a0e9-957f422da840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (841a76a6-293b-4375-ac21-3216aa1b8a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-11c1fe93-9837-4cd9-ae48-e1a36b514596 tempest-CreateVolumesFromImageTest-450068903 None] Created volume successfully. Nov 02 12:00:43 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Temporary image 8f5ccadc-22ba-4102-b6eb-7302146301fa is fetched for user a0ee8e89f914450990bef5dac09c31f8. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c3e763-baa3-449f-aaa8-4bc12b7b7c46]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:44 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD Nov 02 12:00:44 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:44 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 1073741824" returned: 0 in 0.497s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:44 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:44 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 Nov 02 12:00:44 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:44 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD Nov 02 12:00:44 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:44 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027" returned: 0 in 0.246s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.641s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6da39c2-00dd-4b27-b05a-c887aa578e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7a0ce8-792e-4abf-84af-cd5ae417450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Creating offline snapshot 2cee3894-7140-4be0-9d09-33a03e4f13e4 of volume d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:00:44 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Volume volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 (c075bdb9-fb9a-42fb-8f02-2e5fa4da2027): created successfully Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7a0ce8-792e-4abf-84af-cd5ae417450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Flow 'volume_create_manager' (d2ba5969-6bc1-45c8-9a75-e415cf2ce3ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c45ea98-65f2-4250-bf18-8027b676385f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c6c98871-dcf5-4de9-b28b-f004ef4f949a tempest-CreateVolumesFromImageTest-450068903 None] Created volume successfully. Nov 02 12:00:44 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:00:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:44 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d Nov 02 12:00:44 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:45 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d" returned: 0 in 0.376s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:45 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 1G Nov 02 12:00:45 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:45 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 1G" returned: 0 in 0.403s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d15e03-b957-42da-9089-1ea43918645d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:45 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d15e03-b957-42da-9089-1ea43918645d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 Nov 02 12:00:45 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:45 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d15e03-b957-42da-9089-1ea43918645d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4" returned: 0 in 0.312s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:45 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 is being set with open permissions: ugo+rw Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:45 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 Nov 02 12:00:45 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-quobyte-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2089c8ad-d3f7-41e8-a377-70ce1a369caa]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:45 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 Nov 02 12:00:45 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:46 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:46 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.info Nov 02 12:00:46 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:46 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:46 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027 Nov 02 12:00:46 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:46 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.info" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:46 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.info is being set with open permissions: ugo+rw Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:46 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.info Nov 02 12:00:46 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:46 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027" returned: 0 in 0.241s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027" released by "delete_volume" :: held 0.654s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Created reservations ['b540c214-c98b-4a4b-82d0-f9a87e5a85fc', 'a3ee0812-0e19-40f8-b70d-add452f6d1b9', '30ceef7e-79bc-4d7f-8dd7-16438c43c1d2', '8d5d17f1-0942-4470-a589-8e5d05fb9b4d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:46 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:46 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:46 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.info" returned: 0 in 0.286s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.404s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610333053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad9e7d5-2402-4603-8d1c-549d0239b729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:41Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Creating volume fad9e7d5-2402-4603-8d1c-549d0239b729 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:46 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:46 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 1073741824 Nov 02 12:00:46 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c7f2a7dc-ad65-43a4-b228-9201f480cf1f tempest-CreateVolumesFromSnapshotTest-670914979 None] Create snapshot completed successfully Nov 02 12:00:46 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Deleted volume successfully. Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ecd23eab-d65b-42bd-af01-9e52058ad467 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-c075bdb9-fb9a-42fb-8f02-2e5fa4da2027-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-6c81d35f-9d80-4521-a4ac-d4753eece932-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-6c81d35f-9d80-4521-a4ac-d4753eece932-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-quobyte-6c81d35f-9d80-4521-a4ac-d4753eece932" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-6c81d35f-9d80-4521-a4ac-d4753eece932" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[11960fa0-6329-4f67-b5dd-a5d2809f59ee]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:47 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 Nov 02 12:00:47 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:47 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 1073741824" returned: 0 in 0.495s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:47 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 Nov 02 12:00:47 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:47 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932" returned: 0 in 0.428s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:47 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932 Nov 02 12:00:47 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:47 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.814s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367336222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e713702b-5783-45fb-b39d-d189dcc5f5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:41Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Creating volume e713702b-5783-45fb-b39d-d189dcc5f5c6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:47 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af476ae0-5dd8-40ea-8aac-b9994e10ee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad9e7d5-2402-4603-8d1c-549d0239b729', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:47 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 1073741824 Nov 02 12:00:47 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87ef828-5df1-4e45-ac21-60e6b0f228c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume volume-fad9e7d5-2402-4603-8d1c-549d0239b729 (fad9e7d5-2402-4603-8d1c-549d0239b729): created successfully Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87ef828-5df1-4e45-ac21-60e6b0f228c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (ac787073-ed6e-4cd3-a47f-f0a61d2f42e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-24338dbe-b8e4-4fca-8339-5cdbe06b315d tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created volume successfully. Nov 02 12:00:47 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6c81d35f-9d80-4521-a4ac-d4753eece932" returned: 0 in 0.353s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-6c81d35f-9d80-4521-a4ac-d4753eece932" released by "delete_volume" :: held 0.838s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (82bab715-def7-4276-9f87-19e2ccdb38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7099dd4b-0f2d-462e-a04c-14886f467bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7099dd4b-0f2d-462e-a04c-14886f467bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806110433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3070a1-6cda-4a63-a484-7c7bc6a635ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:48Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabc8af3-9f96-414d-a4c4-2f841a035001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabc8af3-9f96-414d-a4c4-2f841a035001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e27a8e3-e602-4acc-b037-efed333e4b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e27a8e3-e602-4acc-b037-efed333e4b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3070a1-6cda-4a63-a484-7c7bc6a635ec', 'volume_name': 'volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655737c9-6e8f-456e-b2f3-a9493891d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655737c9-6e8f-456e-b2f3-a9493891d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1098629-9c2c-476a-ad19-02d79281676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume fd3070a1-6cda-4a63-a484-7c7bc6a635ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec', 'volume_size': 1} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:47 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Created reservations ['30c73fc0-2f81-4e19-8bfe-5fce56a0d818', '428b2d91-d947-44f4-8f99-8602440e5497', '8e6b6f53-f78e-4996-b0fd-1c0dd798979b', '56007190-465f-439c-88bb-e9de3051e550'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:48 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:48 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-677e95a0-711b-463f-9fcc-bd0bc1887f3a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-677e95a0-711b-463f-9fcc-bd0bc1887f3a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:48 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 1073741824" returned: 0 in 0.688s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-quobyte-677e95a0-711b-463f-9fcc-bd0bc1887f3a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-677e95a0-711b-463f-9fcc-bd0bc1887f3a" acquired by "delete_volume" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cea65e-aa41-461e-a458-44e84fa1444e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:48 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 Nov 02 12:00:48 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (773fa8b8-4b88-4877-a4a2-9eef3808e5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:48 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2de06c-f34b-4c7d-9c02-b7e95de0edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a Nov 02 12:00:48 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.470s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Deleted volume successfully. Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2de06c-f34b-4c7d-9c02-b7e95de0edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516548076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626ed325-defe-49df-8fbf-7442fbbf3509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:48Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bcc30d-e1ce-437e-92aa-d2ea723491be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bcc30d-e1ce-437e-92aa-d2ea723491be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d502d61-0dee-4376-9680-f4f900433c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d502d61-0dee-4376-9680-f4f900433c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626ed325-defe-49df-8fbf-7442fbbf3509', 'volume_name': 'volume-626ed325-defe-49df-8fbf-7442fbbf3509', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7b8483-eed2-400d-9c81-99a28b3415cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7b8483-eed2-400d-9c81-99a28b3415cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1467b97-d9ff-4947-b6ca-b94db2ce1b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume 626ed325-defe-49df-8fbf-7442fbbf3509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626ed325-defe-49df-8fbf-7442fbbf3509', 'volume_size': 1} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6764b7f2-a966-407b-9c45-462cd7172591 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-6c81d35f-9d80-4521-a4ac-d4753eece932-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:48 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6" returned: 0 in 0.420s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.466s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791070088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2eaad7-9fa7-487e-b53f-714e7d3656c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:42Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Creating volume 6f2eaad7-9fa7-487e-b53f-714e7d3656c0 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:48 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:48 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 1073741824 Nov 02 12:00:48 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa51a328-2e41-49a0-8e38-c397282b3225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e713702b-5783-45fb-b39d-d189dcc5f5c6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a20f4-5f00-459d-9f9b-97efcabb0929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 (e713702b-5783-45fb-b39d-d189dcc5f5c6): created successfully Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2a20f4-5f00-459d-9f9b-97efcabb0929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (4a748df2-e367-4bcf-a15a-8709eafb1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a" returned: 0 in 0.533s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-101110a4-93e3-412a-978f-5d395bb6b47c tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created volume successfully. Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:48 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a Nov 02 12:00:48 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (0cafe279-c139-49d5-ba2a-2c723b43bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bddac2c-6481-4aa2-9946-432d89df6f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bddac2c-6481-4aa2-9946-432d89df6f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164687100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf49cd7-9e11-40da-b6b1-03b18268b739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:49Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e9a2bf-410a-4ce9-87de-37e6d19fdb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e9a2bf-410a-4ce9-87de-37e6d19fdb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196ff192-a49b-401f-a2e5-2a302f3b2866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196ff192-a49b-401f-a2e5-2a302f3b2866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf49cd7-9e11-40da-b6b1-03b18268b739', 'volume_name': 'volume-1bf49cd7-9e11-40da-b6b1-03b18268b739', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5321be-8c09-4314-be9f-23fa63085801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5321be-8c09-4314-be9f-23fa63085801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ce23df-26c8-4456-86ba-9ea4626ff999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume 1bf49cd7-9e11-40da-b6b1-03b18268b739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf49cd7-9e11-40da-b6b1-03b18268b739', 'volume_size': 1} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:49 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-677e95a0-711b-463f-9fcc-bd0bc1887f3a" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-677e95a0-711b-463f-9fcc-bd0bc1887f3a" released by "delete_volume" :: held 1.020s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Created reservations ['db2c3da6-f712-4f48-9b34-b9c7c5bc28b1', 'eec90761-e215-4f82-9da5-64227f23b8aa', '79b1426e-8270-4a06-9757-75a434b67741', '83c414cd-99ea-4134-a9a9-fce7d4bde912'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:49 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 1073741824" returned: 0 in 0.635s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (f5d93f3b-2ea8-4c33-81af-5347ba81930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0d7515-79b6-470e-96af-433f3f89113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0d7515-79b6-470e-96af-433f3f89113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1437835015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072dbb9b-187a-4732-8801-560800a7c222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:49Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7ec61-a3c4-4f33-af43-ad2796cad668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7ec61-a3c4-4f33-af43-ad2796cad668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481c64dd-b15d-40ac-ade8-b3b64412e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481c64dd-b15d-40ac-ade8-b3b64412e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072dbb9b-187a-4732-8801-560800a7c222', 'volume_name': 'volume-072dbb9b-187a-4732-8801-560800a7c222', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801e35e5-e632-4460-a97a-a8296770d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801e35e5-e632-4460-a97a-a8296770d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7147c24f-61e1-4653-bba0-3b97bf3f7cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume 072dbb9b-187a-4732-8801-560800a7c222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072dbb9b-187a-4732-8801-560800a7c222', 'volume_size': 1} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:49 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 Nov 02 12:00:49 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:49 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:49 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:49 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:49 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.052s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1447142350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7576dd75-6fe0-4174-a937-7fef51d403f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:43Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Creating volume 7576dd75-6fe0-4174-a937-7fef51d403f7 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:49 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Deleted volume successfully. Nov 02 12:00:49 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 1073741824 Nov 02 12:00:49 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3420be51-73df-46f0-97ad-f2be6037d95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc2992e-598f-48a9-b5c3-a46a02ffb84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (9bab63ed-157e-44d6-9ffe-c5657aacb36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ecec04-ae04-44be-97ba-e1cf5baaf563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ecec04-ae04-44be-97ba-e1cf5baaf563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248455392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0e40df-c8ca-4579-a4c5-047ed7546f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:50Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deaacbd7-631d-4947-aaea-47d5b97769b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:49 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deaacbd7-631d-4947-aaea-47d5b97769b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607834d7-bf25-41c5-ae91-e7cff59cbcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607834d7-bf25-41c5-ae91-e7cff59cbcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0e40df-c8ca-4579-a4c5-047ed7546f9c', 'volume_name': 'volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3de72c-b39c-4a1d-a4d8-5c11686c36ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3de72c-b39c-4a1d-a4d8-5c11686c36ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857b4b9b-6b9e-46f5-a7a3-b4730e588171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume 0d0e40df-c8ca-4579-a4c5-047ed7546f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c', 'volume_size': 1} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf58c1af-039f-42bb-8538-a93763638f4e tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-677e95a0-711b-463f-9fcc-bd0bc1887f3a-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 (6f2eaad7-9fa7-487e-b53f-714e7d3656c0): created successfully Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc2992e-598f-48a9-b5c3-a46a02ffb84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (4562336c-37a1-459c-a7ff-a29862eb235c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ca3b8bbb-1cff-4b02-83ac-58e8095a3b93 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created volume successfully. Nov 02 12:00:50 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 1073741824" returned: 0 in 0.475s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-40627edc-3ac9-4dd6-b8bc-754d29fe347d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-40627edc-3ac9-4dd6-b8bc-754d29fe347d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:50 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 Nov 02 12:00:50 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-quobyte-40627edc-3ac9-4dd6-b8bc-754d29fe347d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-40627edc-3ac9-4dd6-b8bc-754d29fe347d" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae0c27e-73fc-4a02-90e2-cde0abb10f2c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:50 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d Nov 02 12:00:50 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:50 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.487s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113889605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6ac763-eeb1-499f-9566-b8179c2d8026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a554f9ba7be413fa42b5591df759f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:43Z,use_quota=True,user_id='3b580f3480d64d76a687a5008e0296a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Creating volume ca6ac763-eeb1-499f-9566-b8179c2d8026 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:50 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:50 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 1073741824 Nov 02 12:00:50 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602c74f1-b5bc-4607-bab3-0cbb5c46b3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7576dd75-6fe0-4174-a937-7fef51d403f7', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fd380b-70c1-428b-aa59-64e5e127f73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume volume-7576dd75-6fe0-4174-a937-7fef51d403f7 (7576dd75-6fe0-4174-a937-7fef51d403f7): created successfully Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fd380b-70c1-428b-aa59-64e5e127f73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (2426a424-92da-4608-b508-f5cf57947dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6d9906a0-791b-437f-9b58-32f3d3c4e792 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created volume successfully. Nov 02 12:00:50 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d" returned: 0 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:50 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d Nov 02 12:00:50 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:51 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 1073741824" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:51 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-40627edc-3ac9-4dd6-b8bc-754d29fe347d" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-40627edc-3ac9-4dd6-b8bc-754d29fe347d" released by "delete_volume" :: held 0.727s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:51 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 Nov 02 12:00:51 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Created reservations ['8503cd5f-b7c2-4241-90e9-7a2166ae8b50', 'e33dd02d-13a0-4a78-a354-3bc8edb72bf8', '15c92f57-b7b1-442f-9fdc-9a4a0cbb913b', 'f90e7a31-ff06-4682-93d7-05fff0994832'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:51 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:51 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:51 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.758s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3160454-55df-47d1-a82b-1586b7c8be10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdadcbe32394d10ab74480a5dea75c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:42Z,use_quota=True,user_id='a0ee8e89f914450990bef5dac09c31f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40d1d0ce-b5b3-47b9-96da-ea92df0601c2),volume_type_id=40d1d0ce-b5b3-47b9-96da-ea92df0601c2)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Creating volume b3160454-55df-47d1-a82b-1586b7c8be10 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:51 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:51 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 1073741824 Nov 02 12:00:51 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7a93f7-78b0-4399-937f-86754157b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6ac763-eeb1-499f-9566-b8179c2d8026', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5a5dab-1c17-472f-89fe-f7e54949bb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Volume volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 (ca6ac763-eeb1-499f-9566-b8179c2d8026): created successfully Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5a5dab-1c17-472f-89fe-f7e54949bb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Flow 'volume_create_manager' (a5898d4d-da0d-4583-9f43-0880cac35155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eeea70db-6567-441d-a873-e2945b7adabc tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created volume successfully. Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-4ddbc50c-f521-473b-82c7-e89e468f2348-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-4ddbc50c-f521-473b-82c7-e89e468f2348-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:51 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Deleted volume successfully. Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "cinder-quobyte-4ddbc50c-f521-473b-82c7-e89e468f2348" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-4ddbc50c-f521-473b-82c7-e89e468f2348" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bd259284-6be5-4e1e-ba43-0ed436045854 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-40627edc-3ac9-4dd6-b8bc-754d29fe347d-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe938ef-d8df-495a-bf70-d512f635c032]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:51 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 Nov 02 12:00:51 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-ca6ac763-eeb1-499f-9566-b8179c2d8026-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-ca6ac763-eeb1-499f-9566-b8179c2d8026-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-quobyte-ca6ac763-eeb1-499f-9566-b8179c2d8026" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-ca6ac763-eeb1-499f-9566-b8179c2d8026" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1cc092-ad1b-4901-9e72-0c45153e5099]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:52 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 1073741824" returned: 0 in 0.599s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:52 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 Nov 02 12:00:52 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:52 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:52 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 Nov 02 12:00:52 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348" returned: 0 in 0.473s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:52 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348 Nov 02 12:00:52 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:52 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.463s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806110433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3070a1-6cda-4a63-a484-7c7bc6a635ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:48Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Creating volume fd3070a1-6cda-4a63-a484-7c7bc6a635ec {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:52 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:52 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec 1073741824 Nov 02 12:00:52 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Attempting download of 8f5ccadc-22ba-4102-b6eb-7302146301fa ((None, [{'url': 'file:///opt/stack/data/glance/images/8f5ccadc-22ba-4102-b6eb-7302146301fa', 'metadata': {}}])) to volume b3160454-55df-47d1-a82b-1586b7c8be10. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:00:52 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:52 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-4ddbc50c-f521-473b-82c7-e89e468f2348" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:52 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026 Nov 02 12:00:52 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-quobyte-4ddbc50c-f521-473b-82c7-e89e468f2348" released by "delete_volume" :: held 0.825s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6f359-9b4b-4e71-9cb9-1e4ebd3264c3]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f5ccadc-22ba-4102-b6eb-7302146301fa_zpqf8hb0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Created reservations ['2b2f66e6-965a-47b6-b5ed-0de8b537641f', 'db87707c-d8bd-4c4d-baff-446067c3edd7', '27d7178a-bbc0-4403-afe9-9cedb4525f03', 'e1d3b798-ce04-4b8d-a22c-24340883c5fe'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:52 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f5ccadc-22ba-4102-b6eb-7302146301fa_zpqf8hb0 Nov 02 12:00:52 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:52 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:52 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:52 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ca6ac763-eeb1-499f-9566-b8179c2d8026" returned: 0 in 0.342s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-ca6ac763-eeb1-499f-9566-b8179c2d8026" released by "delete_volume" :: held 0.791s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created reservations ['704b4b29-8cfc-4a06-98af-ce62fc1cc959', '0f1a1a5e-e745-459b-b364-103f6163387e', '850b0121-8908-4d5d-baa6-c60ffe05761a', 'dac422af-aa7a-4151-949e-94e7673e2e63'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:52 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f5ccadc-22ba-4102-b6eb-7302146301fa_zpqf8hb0" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f5ccadc-22ba-4102-b6eb-7302146301fa_zpqf8hb0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:53 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec 1073741824" returned: 0 in 0.663s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:53 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.397s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Deleted volume successfully. Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-182e3bdd-96ae-492b-b24d-594bf5eea8d1 tempest-CreateVolumesFromImageTest-450068903 None] Lock "cinder-4ddbc50c-f521-473b-82c7-e89e468f2348-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-7576dd75-6fe0-4174-a937-7fef51d403f7-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:53 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec Nov 02 12:00:53 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:53 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f5ccadc-22ba-4102-b6eb-7302146301fa_zpqf8hb0 Nov 02 12:00:53 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-7576dd75-6fe0-4174-a937-7fef51d403f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:53 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:53 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-quobyte-7576dd75-6fe0-4174-a937-7fef51d403f7" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-7576dd75-6fe0-4174-a937-7fef51d403f7" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[48308c31-1c84-4f79-8882-573ed03b60c4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:53 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 Nov 02 12:00:53 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:53 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f5ccadc-22ba-4102-b6eb-7302146301fa_zpqf8hb0" returned: 1 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f5ccadc-22ba-4102-b6eb-7302146301fa_zpqf8hb0' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede82a2e-8ace-401d-a4dc-70a36af7ca96]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:53 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.399s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Deleted volume successfully. Nov 02 12:00:53 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-08f7fac5-6dfd-4ede-8d96-41fda9fb2ef2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-ca6ac763-eeb1-499f-9566-b8179c2d8026-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.973s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516548076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626ed325-defe-49df-8fbf-7442fbbf3509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:48Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Creating volume 626ed325-defe-49df-8fbf-7442fbbf3509 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:53 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:53 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 1073741824 Nov 02 12:00:53 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1098629-9c2c-476a-ad19-02d79281676b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba40e035-603d-4703-a071-5b10d1da5417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:53 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD Nov 02 12:00:53 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec (fd3070a1-6cda-4a63-a484-7c7bc6a635ec): created successfully Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba40e035-603d-4703-a071-5b10d1da5417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (82bab715-def7-4276-9f87-19e2ccdb38cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:53 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-90278d5b-ba8f-4b29-8ffd-f39444e6d6ac tempest-CreateVolumesFromSnapshotTest-670914979 None] Created volume successfully. Nov 02 12:00:53 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:53 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7 Nov 02 12:00:53 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:54 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:54 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD Nov 02 12:00:54 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:54 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7576dd75-6fe0-4174-a937-7fef51d403f7" returned: 0 in 0.433s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-7576dd75-6fe0-4174-a937-7fef51d403f7" released by "delete_volume" :: held 1.018s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:54 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 1073741824" returned: 0 in 0.713s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:54 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 Nov 02 12:00:54 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created reservations ['95a42479-17fc-4db9-9751-ee090acd7017', '53884bd0-8afd-4354-a7c0-94d99ac2f945', 'bdb73733-0338-4e3f-865b-06ae7670bab7', '1f75acea-cdd1-4ef9-abda-c15fb9091a4f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:54 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:54 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:54 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD" returned: 1 in 0.538s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] 8f5ccadc-22ba-4102-b6eb-7302146301fa was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:54 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 Nov 02 12:00:54 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:54 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164687100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf49cd7-9e11-40da-b6b1-03b18268b739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:49Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Creating volume 1bf49cd7-9e11-40da-b6b1-03b18268b739 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:54 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1467b97-d9ff-4947-b6ca-b94db2ce1b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626ed325-defe-49df-8fbf-7442fbbf3509', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:54 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 1073741824 Nov 02 12:00:54 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81c54f3-c83b-4b7d-95be-66891ba9ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume volume-626ed325-defe-49df-8fbf-7442fbbf3509 (626ed325-defe-49df-8fbf-7442fbbf3509): created successfully Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81c54f3-c83b-4b7d-95be-66891ba9ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (773fa8b8-4b88-4877-a4a2-9eef3808e5bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0d3b0135-3957-46f0-a8e4-3fc9f51cd569 tempest-CreateVolumesFromSnapshotTest-670914979 None] Created volume successfully. Nov 02 12:00:54 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Deleted volume successfully. Nov 02 12:00:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-798ae087-b40d-4fa7-a6cd-ae568f83f0c2 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-7576dd75-6fe0-4174-a937-7fef51d403f7-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:55 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10" returned: 0 in 0.675s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f5ccadc-22ba-4102-b6eb-7302146301fa_wz_92ehrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:00:55 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:55 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 1G Nov 02 12:00:55 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:55 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 1073741824" returned: 0 in 0.744s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-6f2eaad7-9fa7-487e-b53f-714e7d3656c0-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-6f2eaad7-9fa7-487e-b53f-714e7d3656c0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:55 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 Nov 02 12:00:55 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-quobyte-6f2eaad7-9fa7-487e-b53f-714e7d3656c0" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-6f2eaad7-9fa7-487e-b53f-714e7d3656c0" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0646d-ad31-468d-b6f1-9053bbba5b48]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:55 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 1G" returned: 0 in 0.469s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Downloaded image 8f5ccadc-22ba-4102-b6eb-7302146301fa ((None, [{'url': 'file:///opt/stack/data/glance/images/8f5ccadc-22ba-4102-b6eb-7302146301fa', 'metadata': {}}])) to volume b3160454-55df-47d1-a82b-1586b7c8be10 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Temporary image 8f5ccadc-22ba-4102-b6eb-7302146301fa for user a0ee8e89f914450990bef5dac09c31f8 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Marking volume b3160454-55df-47d1-a82b-1586b7c8be10 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Copying metadata from image 8f5ccadc-22ba-4102-b6eb-7302146301fa to b3160454-55df-47d1-a82b-1586b7c8be10. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Creating volume glance metadata for volume b3160454-55df-47d1-a82b-1586b7c8be10 backed by image 8f5ccadc-22ba-4102-b6eb-7302146301fa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8f5ccadc-22ba-4102-b6eb-7302146301fa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'af1ced6895140292da637897e2ad4fdf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:00:55 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 Nov 02 12:00:55 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfd19a7-fff8-481a-b1ca-0031d8d28750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3160454-55df-47d1-a82b-1586b7c8be10', 'volume_size': 1, 'image_id': '8f5ccadc-22ba-4102-b6eb-7302146301fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f5ccadc-22ba-4102-b6eb-7302146301fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af1ced6895140292da637897e2ad4fdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fdadcbe32394d10ab74480a5dea75c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '373a261fcb91c505821454140bb658511bc6572d2531e15edd0122aa98f6f75d15cb7c6ab8b853fd110abea7db933215e63093535a10526d75f99b32ad6aa0c3', 'id': '8f5ccadc-22ba-4102-b6eb-7302146301fa', 'created_at': datetime.datetime(2026, 11, 2, 11, 0, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 0, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f5ccadc-22ba-4102-b6eb-7302146301fa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce75eac-cf43-4ddb-8125-e5af146bd20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Volume volume-b3160454-55df-47d1-a82b-1586b7c8be10 (b3160454-55df-47d1-a82b-1586b7c8be10): created successfully Nov 02 12:00:55 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce75eac-cf43-4ddb-8125-e5af146bd20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Flow 'volume_create_manager' (60e09850-3d6b-4afb-88a5-0c1be00de14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.365s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1437835015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072dbb9b-187a-4732-8801-560800a7c222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:49Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Creating volume 072dbb9b-187a-4732-8801-560800a7c222 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:55 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2fbfc956-f214-4c67-895b-f2bc4962493a tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Created volume successfully. Nov 02 12:00:55 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 1073741824 Nov 02 12:00:55 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ce23df-26c8-4456-86ba-9ea4626ff999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf49cd7-9e11-40da-b6b1-03b18268b739', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705a23ae-32af-437d-b2b9-83d46b32ca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 (1bf49cd7-9e11-40da-b6b1-03b18268b739): created successfully Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705a23ae-32af-437d-b2b9-83d46b32ca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (0cafe279-c139-49d5-ba2a-2c723b43bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b1a360bc-084c-4189-947a-c0a00522f6b4 tempest-CreateVolumesFromSnapshotTest-670914979 None] Created volume successfully. Nov 02 12:00:56 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0" returned: 0 in 0.439s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:56 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0 Nov 02 12:00:56 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Acquiring lock "cinder-b3160454-55df-47d1-a82b-1586b7c8be10-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "cinder-b3160454-55df-47d1-a82b-1586b7c8be10-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Acquiring lock "cinder-quobyte-b3160454-55df-47d1-a82b-1586b7c8be10" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:56 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f2eaad7-9fa7-487e-b53f-714e7d3656c0" returned: 0 in 0.337s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-6f2eaad7-9fa7-487e-b53f-714e7d3656c0" released by "delete_volume" :: held 0.835s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "cinder-quobyte-b3160454-55df-47d1-a82b-1586b7c8be10" acquired by "delete_volume" :: waited 0.042s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[640ea30c-24bd-4626-b007-1d0e48b39143]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created reservations ['c82fe0b0-867a-4a35-bad1-a7ade649a593', 'e16215cb-6184-465c-9f55-1cb2cb9747cd', '50e256e6-e43c-4c96-90d0-87f5e087b42a', 'ec827acb-c6aa-4748-951e-0e1a2c00d3ce'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:56 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 1073741824" returned: 0 in 0.684s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:56 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 Nov 02 12:00:56 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:56 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 Nov 02 12:00:56 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:56 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:56 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-e713702b-5783-45fb-b39d-d189dcc5f5c6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-e713702b-5783-45fb-b39d-d189dcc5f5c6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-quobyte-e713702b-5783-45fb-b39d-d189dcc5f5c6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-e713702b-5783-45fb-b39d-d189dcc5f5c6" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb32303-0300-4ae1-adba-2725ed8dcb22]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:57 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248455392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0e40df-c8ca-4579-a4c5-047ed7546f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa6a948b5dd46e8b7db00254063e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:50Z,use_quota=True,user_id='8daa38bc337d4d3195b7245533ba104f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Creating volume 0d0e40df-c8ca-4579-a4c5-047ed7546f9c {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:57 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7147c24f-61e1-4653-bba0-3b97bf3f7cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072dbb9b-187a-4732-8801-560800a7c222', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:57 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c 1073741824 Nov 02 12:00:57 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc313d0-cf9f-4a80-8b82-3e6901597937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:57 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.438s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Deleted volume successfully. Nov 02 12:00:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume volume-072dbb9b-187a-4732-8801-560800a7c222 (072dbb9b-187a-4732-8801-560800a7c222): created successfully Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc313d0-cf9f-4a80-8b82-3e6901597937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (f5d93f3b-2ea8-4c33-81af-5347ba81930a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-46d18f27-ff1a-423f-9234-e4abd8b2ad82 tempest-CreateVolumesFromSnapshotTest-670914979 None] Created volume successfully. Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-34340789-9089-45bf-98af-3d7778bd7246 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-6f2eaad7-9fa7-487e-b53f-714e7d3656c0-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:57 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10" returned: 0 in 0.729s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:57 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 Nov 02 12:00:57 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:57 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10 Nov 02 12:00:57 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Flow 'volume_create_manager' (ecee7d1e-8650-4c87-a6e2-f2464acbfe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdedae8-2d3f-4b06-a158-37bafe918958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdedae8-2d3f-4b06-a158-37bafe918958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422625579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e8ed1a-3f6c-4395-94f1-833c5600246a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b326dcf18445fa9d2029c2abca4536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:57Z,use_quota=True,user_id='47219973f8ba4e4c9f702f2eddcbeefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4232fa-4574-4857-844f-0ba4cc8820ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4232fa-4574-4857-844f-0ba4cc8820ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:57 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d8e00e-34b1-4fb7-aa37-e3bad29f79f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d8e00e-34b1-4fb7-aa37-e3bad29f79f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e8ed1a-3f6c-4395-94f1-833c5600246a', 'volume_name': 'volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f342927f-bbf6-4102-abd3-a46039d060f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f342927f-bbf6-4102-abd3-a46039d060f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1158e8-9839-499a-aace-0d2a2166c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:57 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Volume b8e8ed1a-3f6c-4395-94f1-833c5600246a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a', 'volume_size': 1} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b3160454-55df-47d1-a82b-1586b7c8be10" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6" returned: 0 in 0.579s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "cinder-quobyte-b3160454-55df-47d1-a82b-1586b7c8be10" released by "delete_volume" :: held 1.150s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:57 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c 1073741824" returned: 0 in 0.549s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6 Nov 02 12:00:57 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:57 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c Nov 02 12:00:57 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Created reservations ['37109972-0bc7-487e-873a-d9fdb74371ff', '2fad2034-a41a-44c2-8d54-fd5de21c2337', 'b34124ee-4cb2-4dee-afc6-79aa0b3bfed8', '0439ed60-4781-48fd-b33f-e7d63b6bf9ba'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:57 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:57 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:57 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e713702b-5783-45fb-b39d-d189dcc5f5c6" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-e713702b-5783-45fb-b39d-d189dcc5f5c6" released by "delete_volume" :: held 0.965s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:57 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c" returned: 0 in 0.319s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422625579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e8ed1a-3f6c-4395-94f1-833c5600246a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b326dcf18445fa9d2029c2abca4536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:00:57Z,use_quota=True,user_id='47219973f8ba4e4c9f702f2eddcbeefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Creating volume b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:00:57 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:00:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857b4b9b-6b9e-46f5-a7a3-b4730e588171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c94841-4cd5-4408-8957-1f58180b9cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:58 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a 1073741824 Nov 02 12:00:58 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Volume volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c (0d0e40df-c8ca-4579-a4c5-047ed7546f9c): created successfully Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c94841-4cd5-4408-8957-1f58180b9cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Flow 'volume_create_manager' (9bab63ed-157e-44d6-9ffe-c5657aacb36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fa6a2635-47a5-406e-80eb-4b861e7d3b2c tempest-CreateVolumesFromSnapshotTest-670914979 None] Created volume successfully. Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created reservations ['a7e1b9ca-a056-44b4-929f-2683e1176c6d', '358908b1-83a5-4711-a27f-7f214ce9b8db', '96e05e1a-6fa8-4204-bef4-8e926af20157', '1fd4afc8-5653-426c-b249-b7e89aed9cd9'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:00:58 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Deleted volume successfully. Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-a43af6b1-8efe-4244-87ea-3ffbe8b6aebc tempest-VolumeAndVolumeTypeFromImageTest-673506444 None] Lock "cinder-b3160454-55df-47d1-a82b-1586b7c8be10-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:58 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:00:58 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:58 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:00:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Deleted volume successfully. Nov 02 12:00:58 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a 1073741824" returned: 0 in 0.462s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-cf600377-c2fe-4b58-8f4b-dde25d744743 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-e713702b-5783-45fb-b39d-d189dcc5f5c6-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:58 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a Nov 02 12:00:58 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:58 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1158e8-9839-499a-aace-0d2a2166c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890c5862-a5e0-4a3e-995c-1d40a8d14059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:00:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Volume volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a (b8e8ed1a-3f6c-4395-94f1-833c5600246a): created successfully Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890c5862-a5e0-4a3e-995c-1d40a8d14059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Flow 'volume_create_manager' (ecee7d1e-8650-4c87-a6e2-f2464acbfe0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:00:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-389a8df4-9a81-4eb2-b350-0117570c8bf7 tempest-VolumeDependencyTests-2131553361 None] Created volume successfully. Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-0d0e40df-c8ca-4579-a4c5-047ed7546f9c-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-0d0e40df-c8ca-4579-a4c5-047ed7546f9c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-0d0e40df-c8ca-4579-a4c5-047ed7546f9c" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:58 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-0d0e40df-c8ca-4579-a4c5-047ed7546f9c" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa09e8ca-c2f7-4c29-9108-3573b58e93f2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-fad9e7d5-2402-4603-8d1c-549d0239b729-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-fad9e7d5-2402-4603-8d1c-549d0239b729-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-quobyte-fad9e7d5-2402-4603-8d1c-549d0239b729" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-fad9e7d5-2402-4603-8d1c-549d0239b729" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf3351-9e8e-4367-a6d1-026323eca626]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:59 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c Nov 02 12:00:59 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:59 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 Nov 02 12:00:59 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:59 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c" returned: 0 in 0.564s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:59 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c Nov 02 12:00:59 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Creating offline snapshot cf9947c0-e405-4e81-ab02-634a4e9ad070 of volume b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b904a96a-792c-4f2b-84f6-a60bb2557704]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:59 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729" returned: 0 in 0.587s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:00:59 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729 Nov 02 12:00:59 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:59 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-0d0e40df-c8ca-4579-a4c5-047ed7546f9c" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:00:59 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a Nov 02 12:00:59 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:00:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-0d0e40df-c8ca-4579-a4c5-047ed7546f9c" released by "delete_volume" :: held 0.972s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Created reservations ['bb00e6ec-7a72-4712-88b0-cc1e1812d49b', 'c169e501-9208-4ab4-9b18-77f3c8656083', '0dcd086d-d25f-4f6e-911e-db1ab3d65f77', '9700e7be-77a3-4228-8abc-16b4a6521c51'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:00 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:00 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:00 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fad9e7d5-2402-4603-8d1c-549d0239b729" returned: 0 in 0.359s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-fad9e7d5-2402-4603-8d1c-549d0239b729" released by "delete_volume" :: held 1.015s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:00 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a" returned: 0 in 0.512s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created reservations ['7316a623-c0fc-40c5-b2ac-cfe0fcf7c537', 'e462bf5e-877d-496e-ab84-c07054dcdeed', '940fac5f-d518-408c-8b6e-277cc2433dc7', 'd6d1cbac-b73b-4b13-9c86-594b019f82ed'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:00 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 1G Nov 02 12:01:00 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:00 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:00 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:00 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Deleted volume successfully. Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3a37de23-5934-4941-9019-6c98bba57e31 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-0d0e40df-c8ca-4579-a4c5-047ed7546f9c-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:00 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Deleted volume successfully. Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-1a8892ec-e862-4abb-aa75-6bad24a67f98 tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-fad9e7d5-2402-4603-8d1c-549d0239b729-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:00 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 1G" returned: 0 in 0.549s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:00 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 Nov 02 12:01:00 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:01 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070" returned: 0 in 0.306s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:01 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 is being set with open permissions: ugo+rw Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:01 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 Nov 02 12:01:01 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-072dbb9b-187a-4732-8801-560800a7c222-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-072dbb9b-187a-4732-8801-560800a7c222-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-072dbb9b-187a-4732-8801-560800a7c222" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-072dbb9b-187a-4732-8801-560800a7c222" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3d0f2e-30c6-452c-bfe4-adfe732f0265]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-6f193454-bc7a-4d2c-a86b-f099e65d6349-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-6f193454-bc7a-4d2c-a86b-f099e65d6349-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:01 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "cinder-quobyte-6f193454-bc7a-4d2c-a86b-f099e65d6349" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070" returned: 0 in 0.360s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-6f193454-bc7a-4d2c-a86b-f099e65d6349" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:01 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 Nov 02 12:01:01 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48c695f-bfc2-41a1-b1ef-66cbde28e884]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:01 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.info Nov 02 12:01:01 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:01 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 Nov 02 12:01:01 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:01 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222" returned: 0 in 0.550s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:01 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:01 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222 Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.info" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:01 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.info is being set with open permissions: ugo+rw Nov 02 12:01:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:01 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:01 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.info Nov 02 12:01:01 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:02 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349" returned: 0 in 0.491s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:02 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349 Nov 02 12:01:02 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:02 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-072dbb9b-187a-4732-8801-560800a7c222" returned: 0 in 0.297s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-072dbb9b-187a-4732-8801-560800a7c222" released by "delete_volume" :: held 0.919s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:02 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.info" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.523s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6cd1bd9c-58a4-48f6-b374-5c205ca33a31 tempest-VolumeDependencyTests-2131553361 None] Create snapshot completed successfully Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Created reservations ['e4942e3d-15bd-433d-ab25-f34ce9b48794', '96ddd78c-1d49-4590-935a-6f82410c9202', '7b41024a-3c14-493b-9479-b74e8dccafe2', '1d60565d-0a02-4ef1-8d00-ea5fd72934c8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:02 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-6f193454-bc7a-4d2c-a86b-f099e65d6349" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-quobyte-6f193454-bc7a-4d2c-a86b-f099e65d6349" released by "delete_volume" :: held 0.902s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:02 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:02 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Created reservations ['8af88c43-a0c7-41eb-850f-42ebb3daa8d5', 'd810bb18-e04e-43d3-95bc-de1d090ec0f0', '0100b99b-c665-4c0b-b5ba-f0822a46f79e', '577389e4-0423-494d-8335-706386a3d7f3'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:02 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:02 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:02 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.308s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Deleted volume successfully. Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e3ecc194-4ddb-4af5-9856-810bce68b825 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-072dbb9b-187a-4732-8801-560800a7c222-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:02 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Deleted volume successfully. Nov 02 12:01:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-12275938-f88f-4208-abf8-9ba4aa673c8b tempest-CreateVolumesFromSourceVolumeTest-469063416 None] Lock "cinder-6f193454-bc7a-4d2c-a86b-f099e65d6349-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-1bf49cd7-9e11-40da-b6b1-03b18268b739-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-1bf49cd7-9e11-40da-b6b1-03b18268b739-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Flow 'volume_create_manager' (63819dd0-d19f-4c92-b1f0-9a6ba1af0bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a64eea3-93fa-45ab-bd98-b728ba096433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-1bf49cd7-9e11-40da-b6b1-03b18268b739" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a64eea3-93fa-45ab-bd98-b728ba096433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-308517912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bacbc2-4754-4591-ae3b-4cb723a05b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b326dcf18445fa9d2029c2abca4536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf9947c0-e405-4e81-ab02-634a4e9ad070,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:04Z,use_quota=True,user_id='47219973f8ba4e4c9f702f2eddcbeefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0233f8ee-b20d-4f92-add6-21bf9a0f056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0233f8ee-b20d-4f92-add6-21bf9a0f056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da37b576-a7e2-4192-b51f-c7d416c39592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da37b576-a7e2-4192-b51f-c7d416c39592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2bacbc2-4754-4591-ae3b-4cb723a05b64', 'volume_name': 'volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64', 'volume_size': 1, 'snapshot_id': 'cf9947c0-e405-4e81-ab02-634a4e9ad070'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd7e683-2384-4ae7-9b40-39a4bea5775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd7e683-2384-4ae7-9b40-39a4bea5775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd1ccff-839a-43f6-9c9c-cb7cb064ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:03 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Volume d2bacbc2-4754-4591-ae3b-4cb723a05b64: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64', 'volume_size': 1, 'snapshot_id': 'cf9947c0-e405-4e81-ab02-634a4e9ad070'} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-quobyte-cf9947c0-e405-4e81-ab02-634a4e9ad070-d2bacbc2-4754-4591-ae3b-4cb723a05b64" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-1bf49cd7-9e11-40da-b6b1-03b18268b739" acquired by "delete_volume" :: waited 0.073s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-cf9947c0-e405-4e81-ab02-634a4e9ad070-d2bacbc2-4754-4591-ae3b-4cb723a05b64" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Creating volume d2bacbc2-4754-4591-ae3b-4cb723a05b64 from snapshot cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-quobyte-d2bacbc2-4754-4591-ae3b-4cb723a05b64" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c4afc2-f29f-48fa-8f0e-a2f8ed8cf3b0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-d2bacbc2-4754-4591-ae3b-4cb723a05b64" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] snapshot: cf9947c0-e405-4e81-ab02-634a4e9ad070, volume: d2bacbc2-4754-4591-ae3b-4cb723a05b64, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b1cc9-0d3d-4c50-9cc6-326b8d46563b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:03 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 Nov 02 12:01:03 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:04 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 Nov 02 12:01:04 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:04 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739" returned: 0 in 0.481s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:04 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739 Nov 02 12:01:04 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:04 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa10ab-87d8-4fad-8f5e-34bd2afe561e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:04 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a Nov 02 12:01:04 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:04 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-1bf49cd7-9e11-40da-b6b1-03b18268b739" returned: 0 in 0.401s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-1bf49cd7-9e11-40da-b6b1-03b18268b739" released by "delete_volume" :: held 0.953s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Created reservations ['59cce2cb-c912-4dfb-bab6-217d61a7f0e1', 'eb13b5a4-3de5-4de1-adbd-135b6da2c8b4', '955119cf-5edc-4e42-9694-ae5b669f3309', '69307ebb-8594-475a-bb78-193b7f016d4d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Flow 'volume_create_manager' (4abdf449-77eb-411e-8bcc-34cf1c908be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7ce763-2e2b-404a-b121-70720c1f4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:04 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7ce763-2e2b-404a-b121-70720c1f4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476ac0a1-96b9-45f6-9c07-b79585787d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690778634abd4a389a97256a934de6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:05Z,use_quota=True,user_id='a48a690f25614388b4a1b057eac6980b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aae0e5f-d329-4e8b-bf08-4c03e8e7dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aae0e5f-d329-4e8b-bf08-4c03e8e7dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127cc541-0a2f-4439-a2d4-f1d2dfe33d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127cc541-0a2f-4439-a2d4-f1d2dfe33d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476ac0a1-96b9-45f6-9c07-b79585787d1b', 'volume_name': 'volume-476ac0a1-96b9-45f6-9c07-b79585787d1b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff301c2-ca80-4586-a2ce-73def069c792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff301c2-ca80-4586-a2ce-73def069c792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e905e2-d191-4598-aa95-a814bee9131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Volume 476ac0a1-96b9-45f6-9c07-b79585787d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476ac0a1-96b9-45f6-9c07-b79585787d1b', 'volume_size': 1} Nov 02 12:01:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:05 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 Nov 02 12:01:05 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:05 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:05 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:05 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Deleted volume successfully. Nov 02 12:01:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-bb109659-d91a-4a90-a07d-b6f80e98c3ba tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-1bf49cd7-9e11-40da-b6b1-03b18268b739-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-626ed325-defe-49df-8fbf-7442fbbf3509-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-626ed325-defe-49df-8fbf-7442fbbf3509-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-626ed325-defe-49df-8fbf-7442fbbf3509" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-626ed325-defe-49df-8fbf-7442fbbf3509" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c73c82f-b9de-41bf-b538-3cd5e4c3a2a1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:06 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 Nov 02 12:01:06 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:07 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509" returned: 0 in 0.781s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:07 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509 Nov 02 12:01:07 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:07 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-626ed325-defe-49df-8fbf-7442fbbf3509" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-626ed325-defe-49df-8fbf-7442fbbf3509" released by "delete_volume" :: held 1.284s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Created reservations ['a497761b-0a5c-4420-be01-adbda40552ea', 'e40b642a-f2c2-4aa6-a5a6-9eb7ab4febb2', 'cc6242f8-09a4-47f9-ada9-69434050ceac', '7d4461f2-4d1b-4505-9900-7f3753553df0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:07 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e5a9b272-3706-4aa4-8f4f-218bcf276c30 tempest-ProjectAdminTests-736382766 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8525581359863, 'free_capacity_gb': 1773.8525581359863, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:08 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:08 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:08 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.459s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Deleted volume successfully. Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2d521802-97b6-4ead-b2e3-53afbb52c4db tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-626ed325-defe-49df-8fbf-7442fbbf3509-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-fd3070a1-6cda-4a63-a484-7c7bc6a635ec-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-fd3070a1-6cda-4a63-a484-7c7bc6a635ec-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-fd3070a1-6cda-4a63-a484-7c7bc6a635ec" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-fd3070a1-6cda-4a63-a484-7c7bc6a635ec" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:09 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[632ed840-b8c0-4436-88c3-b5b1b1859f8c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:09 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec Nov 02 12:01:09 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:09 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec" returned: 0 in 0.587s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:09 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec Nov 02 12:01:09 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:10 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-fd3070a1-6cda-4a63-a484-7c7bc6a635ec" returned: 0 in 0.585s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-fd3070a1-6cda-4a63-a484-7c7bc6a635ec" released by "delete_volume" :: held 1.290s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Created reservations ['ea15658f-40d0-4d92-b9cc-21fc25a39543', 'b603e5ee-1105-4266-be19-d7c62c063afb', 'a3988650-e815-44aa-80af-e578dc388880', '272d3ef1-ab1f-451a-b02c-ffaab85bfeb8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:10 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:10 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:11 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Deleted volume successfully. Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dfc65d20-593e-42bb-b1e6-78b90e3abe7d tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-fd3070a1-6cda-4a63-a484-7c7bc6a635ec-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-2cee3894-7140-4be0-9d09-33a03e4f13e4-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-2cee3894-7140-4be0-9d09-33a03e4f13e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-d8d15e03-b957-42da-9089-1ea43918645d" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-d8d15e03-b957-42da-9089-1ea43918645d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-2cee3894-7140-4be0-9d09-33a03e4f13e4" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-2cee3894-7140-4be0-9d09-33a03e4f13e4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Deleting offline snapshot 2cee3894-7140-4be0-9d09-33a03e4f13e4 of volume d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] snapshot_file for this snap is: volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01c325b-e00c-4fbe-a680-8f3b9dacf429]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:11 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 Nov 02 12:01:11 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:12 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4" returned: 0 in 0.581s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d15e03-b957-42da-9089-1ea43918645d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa75219f-3689-435f-bc61-195d314afc66]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:12 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d Nov 02 12:01:12 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64" returned: 0 in 7.549s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:01:12 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Converted 1024.00 MB image at 135.63 MB/s Nov 02 12:01:12 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 is being set with open permissions: ugo+rw Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:12 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 Nov 02 12:01:12 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:12 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d" returned: 0 in 0.446s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:12 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64" returned: 0 in 0.264s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:12 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 Nov 02 12:01:12 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-d2bacbc2-4754-4591-ae3b-4cb723a05b64" released by "_copy_volume_from_snapshot" :: held 8.999s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-cf9947c0-e405-4e81-ab02-634a4e9ad070-d2bacbc2-4754-4591-ae3b-4cb723a05b64" released by "_create_volume_from_snapshot" :: held 9.086s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.121s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.895s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476ac0a1-96b9-45f6-9c07-b79585787d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690778634abd4a389a97256a934de6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:05Z,use_quota=True,user_id='a48a690f25614388b4a1b057eac6980b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Creating volume 476ac0a1-96b9-45f6-9c07-b79585787d1b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:12 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:12 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b 1073741824 Nov 02 12:01:12 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd1ccff-839a-43f6-9c9c-cb7cb064ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64', 'volume_size': 1, 'snapshot_id': 'cf9947c0-e405-4e81-ab02-634a4e9ad070'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e50892-da36-4cbb-b44e-a5f83eb99e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Volume volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 (d2bacbc2-4754-4591-ae3b-4cb723a05b64): created successfully Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e50892-da36-4cbb-b44e-a5f83eb99e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Flow 'volume_create_manager' (63819dd0-d19f-4c92-b1f0-9a6ba1af0bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-da65c47f-c2eb-4b3c-a64a-b6b83f6f7721 tempest-VolumeDependencyTests-2131553361 None] Created volume successfully. Nov 02 12:01:13 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4" returned: 0 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:13 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4 Nov 02 12:01:13 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:13 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b 1073741824" returned: 0 in 0.479s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:13 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d.2cee3894-7140-4be0-9d09-33a03e4f13e4" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:13 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b Nov 02 12:01:13 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-2cee3894-7140-4be0-9d09-33a03e4f13e4" released by "_delete_snapshot" :: held 1.832s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-d8d15e03-b957-42da-9089-1ea43918645d" released by "delete_snapshot" :: held 1.874s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Created reservations ['0e6ea1e0-c803-44c2-8f01-73227f35c8f2', '8a6e56ab-71cd-4a82-a6c9-c13ad26d021a', 'c6ba86d2-75c7-4e59-8d1b-231e7ac3f786', '99cdedfd-0b75-4af6-aeea-bec5769d0b9b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Delete snapshot completed successfully. Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-83eb8fa6-9353-41fe-8983-236be7918dcb tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-2cee3894-7140-4be0-9d09-33a03e4f13e4-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:13 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-cf9947c0-e405-4e81-ab02-634a4e9ad070-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e905e2-d191-4598-aa95-a814bee9131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476ac0a1-96b9-45f6-9c07-b79585787d1b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21995c7-b247-4709-aa28-bb8ef6468bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-cf9947c0-e405-4e81-ab02-634a4e9ad070-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-quobyte-b8e8ed1a-3f6c-4395-94f1-833c5600246a" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:13 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Volume volume-476ac0a1-96b9-45f6-9c07-b79585787d1b (476ac0a1-96b9-45f6-9c07-b79585787d1b): created successfully Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21995c7-b247-4709-aa28-bb8ef6468bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Flow 'volume_create_manager' (4abdf449-77eb-411e-8bcc-34cf1c908be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-b8e8ed1a-3f6c-4395-94f1-833c5600246a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-quobyte-cf9947c0-e405-4e81-ab02-634a4e9ad070" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-cf9947c0-e405-4e81-ab02-634a4e9ad070" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Deleting offline snapshot cf9947c0-e405-4e81-ab02-634a4e9ad070 of volume b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] snapshot_file for this snap is: volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4b8cd2e1-4a0a-4b62-8f0e-f7577de361c2 tempest-CinderUnicodeTest-726902577 None] Created volume successfully. Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a3d63-7a7f-4d7c-87a6-31c4bbd6d0f5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-d8d15e03-b957-42da-9089-1ea43918645d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-d8d15e03-b957-42da-9089-1ea43918645d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "cinder-quobyte-d8d15e03-b957-42da-9089-1ea43918645d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-d8d15e03-b957-42da-9089-1ea43918645d" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:14 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 Nov 02 12:01:14 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c077d21-074f-40c1-82f3-27f213b4d534]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:14 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d Nov 02 12:01:14 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:14 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070" returned: 0 in 0.416s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0235011-a597-4153-8db6-425c20ab917c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:14 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:14 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a Nov 02 12:01:14 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:14 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d Nov 02 12:01:14 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:14 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d15e03-b957-42da-9089-1ea43918645d" returned: 0 in 0.258s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-quobyte-d8d15e03-b957-42da-9089-1ea43918645d" released by "delete_volume" :: held 0.744s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Created reservations ['fa9170cb-d383-4153-8c99-2fbe5ca4d4da', '7d283321-f65a-4bd3-b997-6890a08504fc', '83732ebf-3e3d-4f48-988a-866f7d43c08c', 'c0b4603b-4760-43ae-821a-4092c327d41e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:14 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:14 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:14 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a" returned: 0 in 0.563s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:14 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 Nov 02 12:01:14 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:15 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Deleted volume successfully. Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-59d6ea21-989c-4c9f-bd74-dc052afdf447 tempest-CreateVolumesFromSnapshotTest-670914979 None] Lock "cinder-d8d15e03-b957-42da-9089-1ea43918645d-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:15 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070" returned: 0 in 0.440s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:15 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070 Nov 02 12:01:15 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Flow 'volume_create_manager' (3c650242-d76d-495e-a486-2e34cb635430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21609ec6-535a-4d19-bf9d-046dca36298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21609ec6-535a-4d19-bf9d-046dca36298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-738128089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd34561-ba44-4d10-ac4c-a865423a482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690778634abd4a389a97256a934de6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:15Z,use_quota=True,user_id='a48a690f25614388b4a1b057eac6980b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30e1edd-ee92-4147-bb40-a09855c0dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30e1edd-ee92-4147-bb40-a09855c0dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d336ea1-3a79-4eca-aa67-08cb02f31944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d336ea1-3a79-4eca-aa67-08cb02f31944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd34561-ba44-4d10-ac4c-a865423a482d', 'volume_name': 'volume-bbd34561-ba44-4d10-ac4c-a865423a482d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e775eda-3192-4fb1-8609-c8e2a2b10e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e775eda-3192-4fb1-8609-c8e2a2b10e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb12ddf3-b3d3-4c1b-8359-72d97a3a9b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Volume bbd34561-ba44-4d10-ac4c-a865423a482d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd34561-ba44-4d10-ac4c-a865423a482d', 'volume_size': 1} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-738128089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd34561-ba44-4d10-ac4c-a865423a482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690778634abd4a389a97256a934de6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:15Z,use_quota=True,user_id='a48a690f25614388b4a1b057eac6980b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Creating volume bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:15 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:15 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d 1073741824 Nov 02 12:01:15 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:15 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a.cf9947c0-e405-4e81-ab02-634a4e9ad070" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-cf9947c0-e405-4e81-ab02-634a4e9ad070" released by "_delete_snapshot" :: held 1.917s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-b8e8ed1a-3f6c-4395-94f1-833c5600246a" released by "delete_snapshot" :: held 1.954s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Created reservations ['3a8adfdc-bf3f-4c10-a130-8d0196e01da1', 'eb4b04fc-e796-46fa-bb5e-f925406bea93', '5900a5ad-ebe6-4e9d-9af8-59246ef4f8ce', '2207f195-ff71-4c9b-8878-f3b4176c6351'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Delete snapshot completed successfully. Nov 02 12:01:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-60e93ab2-fd97-431f-a3f3-a84518c57a58 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-cf9947c0-e405-4e81-ab02-634a4e9ad070-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:16 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d 1073741824" returned: 0 in 0.595s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:16 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d Nov 02 12:01:16 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:16 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb12ddf3-b3d3-4c1b-8359-72d97a3a9b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd34561-ba44-4d10-ac4c-a865423a482d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e750d958-b7c5-44ba-ae47-1f158513f19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:16 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Volume volume-bbd34561-ba44-4d10-ac4c-a865423a482d (bbd34561-ba44-4d10-ac4c-a865423a482d): created successfully Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e750d958-b7c5-44ba-ae47-1f158513f19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:16 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Flow 'volume_create_manager' (3c650242-d76d-495e-a486-2e34cb635430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:16 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-69bedba8-1740-472f-9454-f9459c856d98 tempest-CinderUnicodeTest-726902577 None] Created volume successfully. Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-b8e8ed1a-3f6c-4395-94f1-833c5600246a-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-b8e8ed1a-3f6c-4395-94f1-833c5600246a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-quobyte-b8e8ed1a-3f6c-4395-94f1-833c5600246a" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-b8e8ed1a-3f6c-4395-94f1-833c5600246a" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e8bc9-140a-4585-99ae-0c8d8ac7ba1c]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:17 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a Nov 02 12:01:17 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:17 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:17 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a Nov 02 12:01:17 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Creating offline snapshot d2b509dd-7c25-4295-a899-a5a8c84668d4 of volume bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:01:17 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-b8e8ed1a-3f6c-4395-94f1-833c5600246a" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde05c47-66c9-4ba6-9f56-c84b5304f663]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-b8e8ed1a-3f6c-4395-94f1-833c5600246a" released by "delete_volume" :: held 0.850s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Created reservations ['0368a1e1-c6b6-406c-9d80-5af03b9306fe', '75f5e8ab-d9b0-4f30-b0e2-a560149a6408', 'a45412d8-72f8-44d4-b814-2ee23409c18a', '0974c746-6b8f-47ff-9f4d-c678e65aa305'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:18 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d Nov 02 12:01:18 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:18 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:18 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-d2bacbc2-4754-4591-ae3b-4cb723a05b64-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-d2bacbc2-4754-4591-ae3b-4cb723a05b64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "cinder-quobyte-d2bacbc2-4754-4591-ae3b-4cb723a05b64" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-d2bacbc2-4754-4591-ae3b-4cb723a05b64" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[be04a864-e990-4551-8d3e-186821a50404]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:18 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d" returned: 0 in 0.531s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:18 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 1G Nov 02 12:01:18 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:18 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:18 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 Nov 02 12:01:18 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:18 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Deleted volume successfully. Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0702316c-8f47-4ccb-ac4d-5a7b847f8133 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-b8e8ed1a-3f6c-4395-94f1-833c5600246a-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:18 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:18 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:18 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:19 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64 Nov 02 12:01:19 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:19 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 1G" returned: 0 in 0.601s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd34561-ba44-4d10-ac4c-a865423a482d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:19 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd34561-ba44-4d10-ac4c-a865423a482d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 Nov 02 12:01:19 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:19 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.309s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:01:19 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d2bacbc2-4754-4591-ae3b-4cb723a05b64" returned: 0 in 0.318s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-quobyte-d2bacbc2-4754-4591-ae3b-4cb723a05b64" released by "delete_volume" :: held 0.879s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Created reservations ['8b0eb2be-1f26-42dc-878b-3a0b61816ad9', '260e4841-70f6-4681-b897-3b731473e804', 'f6e4b45a-71b7-4a8d-a68b-cec6a5bc94ca', '23771ac8-146f-4d4f-aa36-170f68cd0600'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:19 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd34561-ba44-4d10-ac4c-a865423a482d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 is being set with open permissions: ugo+rw Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:19 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:19 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:19 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 Nov 02 12:01:19 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:19 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4" returned: 0 in 0.269s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:19 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.info Nov 02 12:01:19 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:19 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.419s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Deleted volume successfully. Nov 02 12:01:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-468d7945-b34d-4e38-9078-2236160ee444 tempest-VolumeDependencyTests-2131553361 None] Lock "cinder-d2bacbc2-4754-4591-ae3b-4cb723a05b64-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:20 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.info" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:20 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.info is being set with open permissions: ugo+rw Nov 02 12:01:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:20 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.info Nov 02 12:01:20 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:20 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.info" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ef9d89f3-4fd8-4466-ac2a-3a1db4f21159 tempest-CinderUnicodeTest-726902577 None] Create snapshot completed successfully Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Acquiring lock "cinder-d2b509dd-7c25-4295-a899-a5a8c84668d4-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Lock "cinder-d2b509dd-7c25-4295-a899-a5a8c84668d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Acquiring lock "cinder-quobyte-bbd34561-ba44-4d10-ac4c-a865423a482d" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-bbd34561-ba44-4d10-ac4c-a865423a482d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Acquiring lock "cinder-quobyte-d2b509dd-7c25-4295-a899-a5a8c84668d4" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-d2b509dd-7c25-4295-a899-a5a8c84668d4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Deleting offline snapshot d2b509dd-7c25-4295-a899-a5a8c84668d4 of volume bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] snapshot_file for this snap is: volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0372f14-126e-4987-aa68-c654ef1fd32d]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:21 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 Nov 02 12:01:21 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:21 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4" returned: 0 in 0.478s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd34561-ba44-4d10-ac4c-a865423a482d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[65364602-4d35-444f-a45e-d616183dc72f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:22 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d Nov 02 12:01:22 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:22 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d" returned: 0 in 0.526s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:22 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 Nov 02 12:01:22 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Flow 'volume_create_manager' (549cad05-64f3-4810-9955-dedbdc78d297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f16500-ccbb-4b30-87de-85ed2cd23137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f16500-ccbb-4b30-87de-85ed2cd23137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae22c4c3-1f09-4a0b-92e2-9628aa701f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9441607e8a04d38a3b1847245bb466d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:23Z,use_quota=True,user_id='e138d3a09ffa4ae88a93f9f1156205a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d81adc-60d5-4e22-826c-7a87cc6452b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d81adc-60d5-4e22-826c-7a87cc6452b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65f80d2-4510-4362-b216-9c1a05c79f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG cinder.image.glance [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Creating Keystone auth plugin from conf {{(pid=86846) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:01:22 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:22 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4 Nov 02 12:01:22 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:23 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d.d2b509dd-7c25-4295-a899-a5a8c84668d4" returned: 0 in 0.280s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-d2b509dd-7c25-4295-a899-a5a8c84668d4" released by "_delete_snapshot" :: held 1.898s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-bbd34561-ba44-4d10-ac4c-a865423a482d" released by "delete_snapshot" :: held 1.935s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65f80d2-4510-4362-b216-9c1a05c79f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae22c4c3-1f09-4a0b-92e2-9628aa701f03', 'volume_name': 'volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03', 'volume_size': 1, 'image_id': '3bbcce59-27c5-4872-9b11-f98c75f169e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bbcce59-27c5-4872-9b11-f98c75f169e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a49bbfcf2fd637d2b35f72488da8e022', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9441607e8a04d38a3b1847245bb466d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62a863c39cbf83cf7b3c9e0e397f08b67a189653c602f1e8beb2b5549bb1591c9d8012971bd350fcbf5a24093897e853b77894039dac7b52dbd28035c57d58a4', 'id': '3bbcce59-27c5-4872-9b11-f98c75f169e1', 'created_at': datetime.datetime(2026, 11, 2, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 1, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bbcce59-27c5-4872-9b11-f98c75f169e1/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d047fc7d-b0b9-41bd-9ef9-37ad9125e136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d047fc7d-b0b9-41bd-9ef9-37ad9125e136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8671cce4-9a03-4716-9e36-ec3b2d6d06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:23 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Volume ae22c4c3-1f09-4a0b-92e2-9628aa701f03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03', 'volume_size': 1, 'image_id': '3bbcce59-27c5-4872-9b11-f98c75f169e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bbcce59-27c5-4872-9b11-f98c75f169e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a49bbfcf2fd637d2b35f72488da8e022', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9441607e8a04d38a3b1847245bb466d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62a863c39cbf83cf7b3c9e0e397f08b67a189653c602f1e8beb2b5549bb1591c9d8012971bd350fcbf5a24093897e853b77894039dac7b52dbd28035c57d58a4', 'id': '3bbcce59-27c5-4872-9b11-f98c75f169e1', 'created_at': datetime.datetime(2026, 11, 2, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 1, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bbcce59-27c5-4872-9b11-f98c75f169e1/file', 'properties': {}}, 'image_service': } Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Trying to clone ae22c4c3-1f09-4a0b-92e2-9628aa701f03 from image 3bbcce59-27c5-4872-9b11-f98c75f169e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3bbcce59-27c5-4872-9b11-f98c75f169e1', 'metadata': {}}]). {{(pid=86846) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Created reservations ['3c666577-7230-46af-80aa-d212289ee599', '7ec75187-5434-402f-9785-422db7478dc3', 'a52ad380-ad06-4533-9289-75e5ebf6a284', 'aa7eda63-4f70-46d1-9b67-93bee4599426'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:01:23 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:01:23 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Delete snapshot completed successfully. Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e484d254-9cd2-466d-8ac4-0376c5c117fb tempest-CinderUnicodeTest-726902577 None] Lock "cinder-d2b509dd-7c25-4295-a899-a5a8c84668d4-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ced82-38d0-4212-af04-ad4fb816ecb6]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:23 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD Nov 02 12:01:23 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:23 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:23 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD Nov 02 12:01:23 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:24 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Temporary image 3bbcce59-27c5-4872-9b11-f98c75f169e1 is fetched for user e138d3a09ffa4ae88a93f9f1156205a9. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf9f86-fa68-4f56-a2ce-3e6a648528ee]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:24 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD Nov 02 12:01:24 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "cinder-bbd34561-ba44-4d10-ac4c-a865423a482d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Lock "cinder-bbd34561-ba44-4d10-ac4c-a865423a482d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:24 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "cinder-quobyte-bbd34561-ba44-4d10-ac4c-a865423a482d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-bbd34561-ba44-4d10-ac4c-a865423a482d" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a72939-5bce-45de-97b2-55b0951764df]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:24 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD Nov 02 12:01:24 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:24 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d Nov 02 12:01:24 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:24 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae22c4c3-1f09-4a0b-92e2-9628aa701f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9441607e8a04d38a3b1847245bb466d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:23Z,use_quota=True,user_id='e138d3a09ffa4ae88a93f9f1156205a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Creating volume ae22c4c3-1f09-4a0b-92e2-9628aa701f03 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:24 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:24 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 1073741824 Nov 02 12:01:24 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:25 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d" returned: 0 in 0.495s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:25 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d Nov 02 12:01:25 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:25 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-bbd34561-ba44-4d10-ac4c-a865423a482d" returned: 0 in 0.339s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:25 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 1073741824" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-bbd34561-ba44-4d10-ac4c-a865423a482d" released by "delete_volume" :: held 0.931s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:25 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 Nov 02 12:01:25 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Created reservations ['c5482c37-e30e-403a-b1e4-1462c7d31d60', 'ade70ad6-3dca-40ff-b49e-7d87aa600d5c', 'b89772c8-7c92-4d28-b655-2a6e4e48bdf1', '8392e1f5-dd41-4c06-b9c7-480d9c70c701'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:25 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:25 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:25 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Attempting download of 3bbcce59-27c5-4872-9b11-f98c75f169e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3bbcce59-27c5-4872-9b11-f98c75f169e1', 'metadata': {}}])) to volume ae22c4c3-1f09-4a0b-92e2-9628aa701f03. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:01:25 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.253s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:25 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Deleted volume successfully. Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ddec1e-5840-4256-804a-9d7ea019ee83]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:25 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bbcce59-27c5-4872-9b11-f98c75f169e1_5l9xzcqt {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-645af114-9a66-46aa-8330-ea806f517017 tempest-CinderUnicodeTest-726902577 None] Lock "cinder-bbd34561-ba44-4d10-ac4c-a865423a482d-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:26 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bbcce59-27c5-4872-9b11-f98c75f169e1_5l9xzcqt Nov 02 12:01:26 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:26 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3bbcce59-27c5-4872-9b11-f98c75f169e1_5l9xzcqt" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bbcce59-27c5-4872-9b11-f98c75f169e1_5l9xzcqt {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:26 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bbcce59-27c5-4872-9b11-f98c75f169e1_5l9xzcqt Nov 02 12:01:26 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:26 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bbcce59-27c5-4872-9b11-f98c75f169e1_5l9xzcqt" returned: 1 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3bbcce59-27c5-4872-9b11-f98c75f169e1_5l9xzcqt' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6762d877-84cf-4490-bcff-9aa7f6b8710c]: (4, 'raw') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Acquiring lock "cinder-476ac0a1-96b9-45f6-9c07-b79585787d1b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Lock "cinder-476ac0a1-96b9-45f6-9c07-b79585787d1b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Acquiring lock "cinder-quobyte-476ac0a1-96b9-45f6-9c07-b79585787d1b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:26 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD Nov 02 12:01:26 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-476ac0a1-96b9-45f6-9c07-b79585787d1b" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52c2642-54ac-4c7a-8263-e049cca4d1d4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:26 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:27 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b Nov 02 12:01:27 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:27 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:27 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD Nov 02 12:01:27 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:27 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b" returned: 0 in 0.494s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:27 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b Nov 02 12:01:27 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:27 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD" returned: 1 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] 3bbcce59-27c5-4872-9b11-f98c75f169e1 was raw, converting to qcow2 {{(pid=86846) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:27 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 Nov 02 12:01:27 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:27 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-476ac0a1-96b9-45f6-9c07-b79585787d1b" returned: 0 in 0.289s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Lock "cinder-quobyte-476ac0a1-96b9-45f6-9c07-b79585787d1b" released by "delete_volume" :: held 0.874s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:27 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Created reservations ['c57febae-4035-4420-b58d-b05ada59b4b9', '9d19721d-d387-4732-a528-0acf0685b34e', '4ea0ac58-0706-4e30-9bce-4c3e44f193f7', '17511be0-e9e2-47d4-a535-ce3e8bc0c25e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:28 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:28 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:28 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.314s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Deleted volume successfully. Nov 02 12:01:28 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42608ef2-c412-42e3-be5f-a55ffaeb2d9a tempest-CinderUnicodeTest-726902577 None] Lock "cinder-476ac0a1-96b9-45f6-9c07-b79585787d1b-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03" returned: 0 in 0.700s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3bbcce59-27c5-4872-9b11-f98c75f169e1_uw0hfvrmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:01:28 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:28 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 1G Nov 02 12:01:28 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:28 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 1G" returned: 0 in 0.354s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Downloaded image 3bbcce59-27c5-4872-9b11-f98c75f169e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3bbcce59-27c5-4872-9b11-f98c75f169e1', 'metadata': {}}])) to volume ae22c4c3-1f09-4a0b-92e2-9628aa701f03 successfully. {{(pid=86846) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Temporary image 3bbcce59-27c5-4872-9b11-f98c75f169e1 for user e138d3a09ffa4ae88a93f9f1156205a9 is deleted. {{(pid=86846) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.volume_utils [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Marking volume ae22c4c3-1f09-4a0b-92e2-9628aa701f03 as bootable. {{(pid=86846) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Copying metadata from image 3bbcce59-27c5-4872-9b11-f98c75f169e1 to ae22c4c3-1f09-4a0b-92e2-9628aa701f03. {{(pid=86846) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Creating volume glance metadata for volume ae22c4c3-1f09-4a0b-92e2-9628aa701f03 backed by image 3bbcce59-27c5-4872-9b11-f98c75f169e1 with: {'image_id': '3bbcce59-27c5-4872-9b11-f98c75f169e1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a49bbfcf2fd637d2b35f72488da8e022', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86846) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8671cce4-9a03-4716-9e36-ec3b2d6d06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03', 'volume_size': 1, 'image_id': '3bbcce59-27c5-4872-9b11-f98c75f169e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3bbcce59-27c5-4872-9b11-f98c75f169e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a49bbfcf2fd637d2b35f72488da8e022', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9441607e8a04d38a3b1847245bb466d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62a863c39cbf83cf7b3c9e0e397f08b67a189653c602f1e8beb2b5549bb1591c9d8012971bd350fcbf5a24093897e853b77894039dac7b52dbd28035c57d58a4', 'id': '3bbcce59-27c5-4872-9b11-f98c75f169e1', 'created_at': datetime.datetime(2026, 11, 2, 11, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 1, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3bbcce59-27c5-4872-9b11-f98c75f169e1/file', 'properties': {}}, 'image_service': }' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e43098-1cd6-4516-9bbf-3fa33c12d47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Volume volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 (ae22c4c3-1f09-4a0b-92e2-9628aa701f03): created successfully Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e43098-1cd6-4516-9bbf-3fa33c12d47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Flow 'volume_create_manager' (549cad05-64f3-4810-9955-dedbdc78d297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-37a04a0c-a70e-4bb1-9b3d-39ace308e025 tempest-VolumeImageDependencyTests-1657099700 None] Created volume successfully. Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Acquiring lock "cinder-ae22c4c3-1f09-4a0b-92e2-9628aa701f03-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Lock "cinder-ae22c4c3-1f09-4a0b-92e2-9628aa701f03-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Acquiring lock "cinder-quobyte-ae22c4c3-1f09-4a0b-92e2-9628aa701f03" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Lock "cinder-quobyte-ae22c4c3-1f09-4a0b-92e2-9628aa701f03" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fbef9c-bfd8-405a-a24f-f349f9191760]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:29 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 Nov 02 12:01:29 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:29 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03" returned: 0 in 0.520s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:29 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03 Nov 02 12:01:29 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:30 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ae22c4c3-1f09-4a0b-92e2-9628aa701f03" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Lock "cinder-quobyte-ae22c4c3-1f09-4a0b-92e2-9628aa701f03" released by "delete_volume" :: held 0.895s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Created reservations ['1eaacde0-23f5-4d1e-a6b5-21dca2c473dd', 'd4da4eca-c856-4d6b-9be4-eaa416710a03', '266e2812-cf60-446c-b792-ad1992e7e179', 'c6fb944b-3979-4bc4-9a7e-53bdb32e28ba'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:30 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:30 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:30 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:30 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Deleted volume successfully. Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-ef37e7c0-8f38-4d31-a392-1fcca4c23165 tempest-VolumeImageDependencyTests-1657099700 None] Lock "cinder-ae22c4c3-1f09-4a0b-92e2-9628aa701f03-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (51e7bf2e-a481-4eea-bb42-973ff5036ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d789d91-1f55-4f43-b92b-52714094c95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d789d91-1f55-4f43-b92b-52714094c95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394359543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f587a44-6db8-46fd-b15e-f7c4ee2aaf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:31Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4802249c-5548-4385-b90f-10f3bab4b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4802249c-5548-4385-b90f-10f3bab4b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:30 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c57ef3-0a94-4f9b-b25e-0988745964ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c57ef3-0a94-4f9b-b25e-0988745964ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f587a44-6db8-46fd-b15e-f7c4ee2aaf44', 'volume_name': 'volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9562cc5c-3500-4eca-8061-d3cfb8de9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9562cc5c-3500-4eca-8061-d3cfb8de9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be5bf43-56b4-4077-b444-828a7a9c690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:31 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Volume 8f587a44-6db8-46fd-b15e-f7c4ee2aaf44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44', 'volume_size': 1} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394359543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f587a44-6db8-46fd-b15e-f7c4ee2aaf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:31Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Creating volume 8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:31 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:31 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 1073741824 Nov 02 12:01:31 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:31 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 1073741824" returned: 0 in 0.596s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:31 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 Nov 02 12:01:31 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:32 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" returned: 0 in 0.418s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be5bf43-56b4-4077-b444-828a7a9c690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6b1052-ffee-4821-ac4c-c5f27e26dd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:32 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Volume volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 (8f587a44-6db8-46fd-b15e-f7c4ee2aaf44): created successfully Nov 02 12:01:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6b1052-ffee-4821-ac4c-c5f27e26dd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:32 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (51e7bf2e-a481-4eea-bb42-973ff5036ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1cbd83ad-1377-4fe1-8157-2c7191c61252 tempest-ProjectReaderTests-1253471065 None] Created volume successfully. Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (eb1fa1a3-16f0-45ba-83bc-e9ceb456201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5eb20a-eb7c-499f-9bdd-73c4b8ffc27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Creating offline snapshot b968d269-aa86-4de2-8ac7-14eb350dea27 of volume 8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5eb20a-eb7c-499f-9bdd-73c4b8ffc27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654606893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3961db-8cd8-46a6-8b71-b6f0df1d3011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:33Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7487ce0b-e43d-4353-bb28-284b3aae806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7487ce0b-e43d-4353-bb28-284b3aae806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9f8365-25d2-4509-8029-cd9893941496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9f8365-25d2-4509-8029-cd9893941496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3961db-8cd8-46a6-8b71-b6f0df1d3011', 'volume_name': 'volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7386a36-9169-4688-8776-023285517da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7386a36-9169-4688-8776-023285517da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c92741-4971-4bd5-bc3f-a37e47a4df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:33 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Volume 8c3961db-8cd8-46a6-8b71-b6f0df1d3011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011', 'volume_size': 1} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7117140-def3-48b9-91ec-a74de332ab35]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:33 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 Nov 02 12:01:33 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:34 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" returned: 0 in 0.404s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:34 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 1G Nov 02 12:01:34 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:34 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 1G" returned: 0 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:34 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 Nov 02 12:01:34 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:34 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:34 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 is being set with open permissions: ugo+rw Nov 02 12:01:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:34 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 Nov 02 12:01:34 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:35 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27" returned: 0 in 0.290s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:35 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.info Nov 02 12:01:35 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:35 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.info" returned: 0 in 0.300s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:35 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.info is being set with open permissions: ugo+rw Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:35 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.info Nov 02 12:01:35 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:35 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.info" returned: 0 in 0.276s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654606893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3961db-8cd8-46a6-8b71-b6f0df1d3011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:33Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Creating volume 8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=200,cinder:UPDATE=276,cinder:INSERT=71,cinder:DELETE=30 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:01:35 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=213,cinder:UPDATE=288,cinder:INSERT=80,cinder:DELETE=20 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:01:35 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 1073741824 Nov 02 12:01:35 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:35 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-801c37f7-ab38-4455-b1be-30236ca5ea86 tempest-ProjectReaderTests-1253471065 None] Create snapshot completed successfully Nov 02 12:01:36 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 1073741824" returned: 0 in 0.543s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:36 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 Nov 02 12:01:36 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:36 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c92741-4971-4bd5-bc3f-a37e47a4df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a89ada1-37a9-47b2-aedd-221e380d96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-b968d269-aa86-4de2-8ac7-14eb350dea27-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Volume volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 (8c3961db-8cd8-46a6-8b71-b6f0df1d3011): created successfully Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a89ada1-37a9-47b2-aedd-221e380d96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (eb1fa1a3-16f0-45ba-83bc-e9ceb456201c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-b968d269-aa86-4de2-8ac7-14eb350dea27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-82e4ccd8-880f-4ad4-8ba7-192a33176f9b tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-b968d269-aa86-4de2-8ac7-14eb350dea27" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-b968d269-aa86-4de2-8ac7-14eb350dea27" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Deleting offline snapshot b968d269-aa86-4de2-8ac7-14eb350dea27 of volume 8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] snapshot_file for this snap is: volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[007862d4-ae67-44a7-abd3-b4961c85fbd0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:36 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 Nov 02 12:01:36 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:37 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:37 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ecbbc0-c975-4cbb-b1c5-a246227c4ff2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:37 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 Nov 02 12:01:37 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:37 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" returned: 0 in 0.465s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:37 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 Nov 02 12:01:37 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 7b01d9a4-148d-442b-b8c1-848aa67175a2 of volume 8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[229872e2-69b9-4d5d-84a8-38620567ae46]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:38 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:38 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 Nov 02 12:01:38 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:38 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27 Nov 02 12:01:38 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:38 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:38 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44.b968d269-aa86-4de2-8ac7-14eb350dea27" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" returned: 0 in 0.479s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-b968d269-aa86-4de2-8ac7-14eb350dea27" released by "_delete_snapshot" :: held 1.831s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:38 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 1G Nov 02 12:01:38 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" released by "delete_snapshot" :: held 1.877s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Created reservations ['28e7c577-187c-4d29-a955-042130855802', '5cacbc15-5a4c-4890-b019-799e0968ebd1', 'a0c4071c-fa7b-4ee3-b7eb-b9ab2a7cd600', '26212fa7-7f05-402a-9039-dc6889afd5f6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:38 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Delete snapshot completed successfully. Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e7d9e1a6-0342-4d4d-be06-479e4143e515 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-b968d269-aa86-4de2-8ac7-14eb350dea27-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" acquired by "delete_volume" :: waited 0.034s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd264f7-fe95-4151-8247-3371bce1abc5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:39 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 Nov 02 12:01:39 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:39 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 1G" returned: 0 in 0.668s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:39 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 Nov 02 12:01:39 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:39 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" returned: 0 in 0.477s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:39 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44 Nov 02 12:01:39 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:39 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2" returned: 0 in 0.416s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:39 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 is being set with open permissions: ugo+rw Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:39 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 Nov 02 12:01:39 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:39 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44" released by "delete_volume" :: held 0.990s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:40 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:40 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.info Nov 02 12:01:40 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Created reservations ['cd32b255-d81f-4150-b17c-a75dde7db402', '7e991f79-abbe-4863-9fc6-df739320d6b6', '3930fe45-d389-42bc-8432-baf28d340cab', '5703da5b-fb98-4713-87a8-d0e0396a3cfd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:40 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:40 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:40 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.info" returned: 0 in 0.306s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.info is being set with open permissions: ugo+rw Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:40 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.info Nov 02 12:01:40 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:40 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.326s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Deleted volume successfully. Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-b36bbecd-8372-4cec-81f8-be15a9384a84 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-8f587a44-6db8-46fd-b15e-f7c4ee2aaf44-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:40 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.info" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:40 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-7f5d5283-7eeb-44db-b7b6-74257cbe5398 tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-7b01d9a4-148d-442b-b8c1-848aa67175a2-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Lock "cinder-7b01d9a4-148d-442b-b8c1-848aa67175a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-7b01d9a4-148d-442b-b8c1-848aa67175a2" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-7b01d9a4-148d-442b-b8c1-848aa67175a2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 7b01d9a4-148d-442b-b8c1-848aa67175a2 of volume 8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d5084-ad09-45b4-905c-b12fddf765ae]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:41 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 Nov 02 12:01:41 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (9aeb03c4-5929-4311-b596-869954f5d0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbe9e66-6673-46d3-89fd-9a78530528f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbe9e66-6673-46d3-89fd-9a78530528f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912339842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41e7de9-dc45-4322-90d3-91b5c37d6e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:42Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840f9f54-0a98-4dca-9110-50f085e9bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:41 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840f9f54-0a98-4dca-9110-50f085e9bf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b75fb2a-a331-4fd0-87cf-c8902a9781d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b75fb2a-a331-4fd0-87cf-c8902a9781d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41e7de9-dc45-4322-90d3-91b5c37d6e8d', 'volume_name': 'volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec9540b-998d-400a-9d28-d4551c03565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec9540b-998d-400a-9d28-d4551c03565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a132f6-08e5-47c3-a0a4-4da3112c1700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:41 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Volume f41e7de9-dc45-4322-90d3-91b5c37d6e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d', 'volume_size': 1} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-912339842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41e7de9-dc45-4322-90d3-91b5c37d6e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:42Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Creating volume f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2" returned: 0 in 0.583s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:41 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d 1073741824 Nov 02 12:01:41 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d84dfc-df24-4b1f-b42b-c422bc21e8c3]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:42 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 Nov 02 12:01:42 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:42 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" returned: 0 in 0.610s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:42 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d 1073741824" returned: 0 in 0.719s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:42 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 Nov 02 12:01:42 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:42 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d Nov 02 12:01:42 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:43 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a132f6-08e5-47c3-a0a4-4da3112c1700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294a801a-aa87-4ff8-8c8d-a51c4694e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:43 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Volume volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d (f41e7de9-dc45-4322-90d3-91b5c37d6e8d): created successfully Nov 02 12:01:43 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294a801a-aa87-4ff8-8c8d-a51c4694e327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (9aeb03c4-5929-4311-b596-869954f5d0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2" returned: 0 in 0.510s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c7702854-260e-40db-a403-e788d77d2e59 tempest-ProjectReaderTests-1253471065 None] Created volume successfully. Nov 02 12:01:43 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2 Nov 02 12:01:43 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:43 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011.7b01d9a4-148d-442b-b8c1-848aa67175a2" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-7b01d9a4-148d-442b-b8c1-848aa67175a2" released by "_delete_snapshot" :: held 2.107s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" released by "delete_snapshot" :: held 2.135s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Created reservations ['54716b96-845c-4d7d-a883-6601addb9592', '79436b4f-090a-4df1-bd69-6c4082639d50', '91cc168c-494d-4755-abc1-8c6d4ef8f1df', '227efab6-65aa-43bd-8281-bb025a9b0077'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:43 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:01:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f7c7632a-9a56-46be-8077-505219ff7aae tempest-ProjectMemberTests-1390221521 None] Lock "cinder-7b01d9a4-148d-442b-b8c1-848aa67175a2-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Creating offline snapshot 2dd3fab3-6f20-416d-a931-feec5d59997a of volume f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be286a1-5205-4e54-ba6d-ab04412f4f38]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:44 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d Nov 02 12:01:44 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-8c3961db-8cd8-46a6-8b71-b6f0df1d3011-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-8c3961db-8cd8-46a6-8b71-b6f0df1d3011-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f8453-8168-4671-bc4a-8438f2f51c53]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:44 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" returned: 0 in 0.470s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:44 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a 1G Nov 02 12:01:44 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:44 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 Nov 02 12:01:44 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:45 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" returned: 0 in 0.518s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:45 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011 Nov 02 12:01:45 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:45 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a 1G" returned: 0 in 0.594s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:45 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a Nov 02 12:01:45 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:45 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8c3961db-8cd8-46a6-8b71-b6f0df1d3011" released by "delete_volume" :: held 0.847s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Created reservations ['6624b664-0252-4ffd-9046-82d88238f9af', 'dfc327cc-8780-43ce-84ed-854cf4258619', '49e417c0-2f81-4867-a77f-a3e448ec9d41', '5e0639ea-8611-4cf8-bf97-88938710142d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:45 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a" returned: 0 in 0.345s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:45 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a is being set with open permissions: ugo+rw Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:45 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:45 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:45 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a Nov 02 12:01:45 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:45 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.313s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:01:45 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a" returned: 0 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f600e62b-53be-40e5-af32-2cb95469d146 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-8c3961db-8cd8-46a6-8b71-b6f0df1d3011-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:46 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.info Nov 02 12:01:46 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (9469e296-b277-4a36-93e7-3a5d1e22f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108fc4f0-5b33-4434-a400-d9ca1f720163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108fc4f0-5b33-4434-a400-d9ca1f720163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531797343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff440410-8053-425e-b69d-84e917005552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:46Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f56541-cc1e-46b8-95d6-bd4f9d00252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f56541-cc1e-46b8-95d6-bd4f9d00252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675adf6b-b5c3-42b4-98c3-fe7e86a42b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675adf6b-b5c3-42b4-98c3-fe7e86a42b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff440410-8053-425e-b69d-84e917005552', 'volume_name': 'volume-ff440410-8053-425e-b69d-84e917005552', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c34edf8-9f93-4499-b077-bfe1ba56fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c34edf8-9f93-4499-b077-bfe1ba56fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4071efd-9d2a-4ae9-9cf9-4b6bb6c16c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Volume ff440410-8053-425e-b69d-84e917005552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff440410-8053-425e-b69d-84e917005552', 'volume_size': 1} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:46 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.info" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:46 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.info is being set with open permissions: ugo+rw Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:46 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.info Nov 02 12:01:46 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:46 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.info" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531797343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff440410-8053-425e-b69d-84e917005552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:46Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Creating volume ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:46 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:46 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 1073741824 Nov 02 12:01:46 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0b5773fb-47d4-4458-b288-4c280bd0532d tempest-ProjectReaderTests-1253471065 None] Create snapshot completed successfully Nov 02 12:01:47 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-2dd3fab3-6f20-416d-a931-feec5d59997a-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 1073741824" returned: 0 in 0.618s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-2dd3fab3-6f20-416d-a931-feec5d59997a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-2dd3fab3-6f20-416d-a931-feec5d59997a" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-2dd3fab3-6f20-416d-a931-feec5d59997a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Deleting offline snapshot 2dd3fab3-6f20-416d-a931-feec5d59997a of volume f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:47 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 Nov 02 12:01:47 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] snapshot_file for this snap is: volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad0e7fc-0255-4fe7-b347-aba2ac256dc7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:47 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a Nov 02 12:01:47 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:47 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552" returned: 0 in 0.371s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4071efd-9d2a-4ae9-9cf9-4b6bb6c16c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff440410-8053-425e-b69d-84e917005552', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c8a5f0-e4a0-4e86-bece-8e813c016ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Volume volume-ff440410-8053-425e-b69d-84e917005552 (ff440410-8053-425e-b69d-84e917005552): created successfully Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c8a5f0-e4a0-4e86-bece-8e813c016ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (9469e296-b277-4a36-93e7-3a5d1e22f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9696767d-d0c3-452a-9499-6512cb4dfa27 tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:01:47 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a" returned: 0 in 0.454s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7460cf4-891a-4bd4-85b2-bd12012bd54b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:48 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d Nov 02 12:01:48 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:48 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" returned: 0 in 0.547s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:48 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a Nov 02 12:01:48 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 8ffe842c-f048-4139-8bef-8635b2abe015 of volume ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[643fe994-1cd5-4d70-a656-bbaa3cd2385a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:49 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 Nov 02 12:01:49 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:49 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a" returned: 0 in 0.651s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:49 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a Nov 02 12:01:49 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:49 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d.2dd3fab3-6f20-416d-a931-feec5d59997a" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:49 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552" returned: 0 in 0.675s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-2dd3fab3-6f20-416d-a931-feec5d59997a" released by "_delete_snapshot" :: held 2.133s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" released by "delete_snapshot" :: held 2.181s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:49 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 1G Nov 02 12:01:49 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Created reservations ['060fa796-4e62-4a2d-b989-f89cb42b6a0f', '48c66929-995f-47cf-8eba-5a6e5150aba6', '85479c6c-1bac-4f9e-bf26-28d937ca9423', 'bea2b939-a1cc-499c-87d6-e76f666ae781'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Delete snapshot completed successfully. Nov 02 12:01:49 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-e0e5a73c-b1e8-4579-8c0c-da6edb37f346 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-2dd3fab3-6f20-416d-a931-feec5d59997a-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:50 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 1G" returned: 0 in 0.511s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff440410-8053-425e-b69d-84e917005552 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:50 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff440410-8053-425e-b69d-84e917005552 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 Nov 02 12:01:50 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:50 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff440410-8053-425e-b69d-84e917005552 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:50 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 is being set with open permissions: ugo+rw Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:50 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 Nov 02 12:01:50 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-f41e7de9-dc45-4322-90d3-91b5c37d6e8d-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-f41e7de9-dc45-4322-90d3-91b5c37d6e8d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[064a8a5a-ad72-49cf-8123-657f5d634005]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:50 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015" returned: 0 in 0.370s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:50 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.info Nov 02 12:01:50 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:50 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d Nov 02 12:01:50 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:51 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.info" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:51 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.info is being set with open permissions: ugo+rw Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:51 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.info Nov 02 12:01:51 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:51 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" returned: 0 in 0.507s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:51 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d Nov 02 12:01:51 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:51 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.info" returned: 0 in 0.292s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:51 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-faadf3f3-0bff-4612-bbe2-dfc4d19a43d0 tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:51 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Flow 'volume_create_manager' (c89958b7-63f4-467e-877a-a279ef4b2577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c35bb49-2aee-4a00-8548-234c53519f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" returned: 0 in 0.426s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c35bb49-2aee-4a00-8548-234c53519f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222474924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a51322e-82eb-448a-ae8c-f96765a48350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3df77cd82a4afab7265b5f10da6b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:52Z,use_quota=True,user_id='259744e74b034c88ba6d6f6ffc82a9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f22c88-17fb-4b11-aa12-fb5e1d53c602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f22c88-17fb-4b11-aa12-fb5e1d53c602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00038715-403e-470e-a000-370991700955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00038715-403e-470e-a000-370991700955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a51322e-82eb-448a-ae8c-f96765a48350', 'volume_name': 'volume-9a51322e-82eb-448a-ae8c-f96765a48350', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e647426d-3668-47d9-8b9b-6d3f7813a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e647426d-3668-47d9-8b9b-6d3f7813a1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fec55f-52e3-44a9-bff7-14ef82e390c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:51 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Volume 9a51322e-82eb-448a-ae8c-f96765a48350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a51322e-82eb-448a-ae8c-f96765a48350', 'volume_size': 1} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222474924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a51322e-82eb-448a-ae8c-f96765a48350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3df77cd82a4afab7265b5f10da6b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:52Z,use_quota=True,user_id='259744e74b034c88ba6d6f6ffc82a9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Creating volume 9a51322e-82eb-448a-ae8c-f96765a48350 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:51 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-f41e7de9-dc45-4322-90d3-91b5c37d6e8d" released by "delete_volume" :: held 1.082s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:51 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 1073741824 Nov 02 12:01:51 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Created reservations ['a5a66209-e829-4b41-a556-39ff0e31637b', '469b6db9-993a-47b8-9ec3-df058c2c106c', '4046b4ad-451c-4b2b-a116-bcf029b603d6', '196979c1-0783-49a9-b7e5-1629a9a00854'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-8ffe842c-f048-4139-8bef-8635b2abe015-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-8ffe842c-f048-4139-8bef-8635b2abe015-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-ff440410-8053-425e-b69d-84e917005552" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:52 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:52 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff440410-8053-425e-b69d-84e917005552" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-8ffe842c-f048-4139-8bef-8635b2abe015" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8ffe842c-f048-4139-8bef-8635b2abe015" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 8ffe842c-f048-4139-8bef-8635b2abe015 of volume ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba4522c-a5dc-4bd7-924c-27cb60ce35dc]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:52 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 Nov 02 12:01:52 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:52 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.384s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Deleted volume successfully. Nov 02 12:01:52 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 1073741824" returned: 0 in 0.652s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c724f00d-3b57-4ae6-92e0-7ba711aff6e4 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-f41e7de9-dc45-4322-90d3-91b5c37d6e8d-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:52 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 Nov 02 12:01:52 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:52 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015" returned: 0 in 0.536s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff440410-8053-425e-b69d-84e917005552(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[882d052c-78ff-43f8-b66a-aad4bcedb847]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:52 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 Nov 02 12:01:52 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:52 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fec55f-52e3-44a9-bff7-14ef82e390c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a51322e-82eb-448a-ae8c-f96765a48350', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ba3c95-c07f-4ca7-97d8-3e33b66534c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:52 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Volume volume-9a51322e-82eb-448a-ae8c-f96765a48350 (9a51322e-82eb-448a-ae8c-f96765a48350): created successfully Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ba3c95-c07f-4ca7-97d8-3e33b66534c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:52 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Flow 'volume_create_manager' (c89958b7-63f4-467e-877a-a279ef4b2577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e3d65c69-06fd-4d2b-98bc-94d709ad8a48 tempest-ProjectReaderTests-714432677 None] Created volume successfully. Nov 02 12:01:53 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552" returned: 0 in 0.516s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:53 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 Nov 02 12:01:53 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (3750f88e-5440-43a6-9933-dbf25350a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083bf2b2-95cb-4de1-af7f-efc7534ec897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083bf2b2-95cb-4de1-af7f-efc7534ec897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888136517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:53Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b36ae09-6f8d-4eff-90cc-743ebdd2c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b36ae09-6f8d-4eff-90cc-743ebdd2c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331d60c6-d073-4cb3-8371-4cc87396c0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331d60c6-d073-4cb3-8371-4cc87396c0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9', 'volume_name': 'volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8916165-3018-43e5-96e6-28e78a29acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8916165-3018-43e5-96e6-28e78a29acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8fdf76-d9c8-456a-865b-fd82d6a42e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:53 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Volume 2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9', 'volume_size': 1} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888136517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:53Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Creating volume 2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:53 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:53 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:53 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 1073741824 Nov 02 12:01:53 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:53 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015 Nov 02 12:01:53 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:54 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552.8ffe842c-f048-4139-8bef-8635b2abe015" returned: 0 in 0.379s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Acquiring lock "cinder-9a51322e-82eb-448a-ae8c-f96765a48350-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8ffe842c-f048-4139-8bef-8635b2abe015" released by "_delete_snapshot" :: held 1.990s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff440410-8053-425e-b69d-84e917005552" released by "delete_snapshot" :: held 2.029s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Lock "cinder-9a51322e-82eb-448a-ae8c-f96765a48350-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Acquiring lock "cinder-quobyte-9a51322e-82eb-448a-ae8c-f96765a48350" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Lock "cinder-quobyte-9a51322e-82eb-448a-ae8c-f96765a48350" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[360b0698-8d58-4af3-ab3c-338fd6a20cbc]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:54 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Created reservations ['a5f10839-33d4-4b9c-9a1c-723a06c5b9b8', '0e85df97-914a-4cac-bffd-cdff20a649d7', 'c26580d9-ebdf-42a2-8679-6ca82aa8418f', '7720e397-dc51-479a-a75a-c979792da746'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 1073741824" returned: 0 in 0.632s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:54 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 Nov 02 12:01:54 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-0189bdfd-b0a7-42c8-86af-5060d3be2105 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-8ffe842c-f048-4139-8bef-8635b2abe015-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:54 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 Nov 02 12:01:54 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:54 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8fdf76-d9c8-456a-865b-fd82d6a42e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aabb451-f39c-49da-b6b4-3b8cbace37d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Volume volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 (2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9): created successfully Nov 02 12:01:54 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aabb451-f39c-49da-b6b4-3b8cbace37d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (3750f88e-5440-43a6-9933-dbf25350a828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350" returned: 0 in 0.463s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d868913d-71a8-4d40-97f0-99b6c33a8d4c tempest-ProjectReaderTests-1253471065 None] Created volume successfully. Nov 02 12:01:54 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350 Nov 02 12:01:54 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:54 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-9a51322e-82eb-448a-ae8c-f96765a48350" returned: 0 in 0.279s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Lock "cinder-quobyte-9a51322e-82eb-448a-ae8c-f96765a48350" released by "delete_volume" :: held 0.795s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Created reservations ['a1dfc272-fc47-4279-b116-2ded442c7c84', '454d96e5-4151-4c80-b1c7-ceeed638969e', 'b986fff2-4af1-45c7-8e6f-a117e943fda4', '87b0c148-c50d-41f7-be98-08489925fb35'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:55 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:55 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-ff440410-8053-425e-b69d-84e917005552-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-ff440410-8053-425e-b69d-84e917005552-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-ff440410-8053-425e-b69d-84e917005552" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff440410-8053-425e-b69d-84e917005552" acquired by "delete_volume" :: waited 0.030s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaf21f8-2047-4e16-9318-7c0e536a4f65]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:55 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.568s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Deleted volume successfully. Nov 02 12:01:55 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-c1dba1f1-c77f-4365-bdff-f03f7417363d tempest-ProjectReaderTests-714432677 None] Lock "cinder-9a51322e-82eb-448a-ae8c-f96765a48350-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:55 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 Nov 02 12:01:55 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:56 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552" returned: 0 in 0.589s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Creating offline snapshot 3b485e58-c995-4383-aebc-53a3030e071c of volume 2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:01:56 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552 Nov 02 12:01:56 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Flow 'volume_create_manager' (837b64b0-e0bc-416a-a4b9-c175dc03fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6808dbcd-d9ed-40e1-abb3-af17fa407107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dafa24d-88eb-441c-bb2a-35b4cd353a14]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6808dbcd-d9ed-40e1-abb3-af17fa407107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270383178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f16220-5009-42a0-80cd-a3fa7bc83944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3df77cd82a4afab7265b5f10da6b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:56Z,use_quota=True,user_id='259744e74b034c88ba6d6f6ffc82a9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e49db8f-a911-416b-a932-c61ab724c9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e49db8f-a911-416b-a932-c61ab724c9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b33477-7de0-479c-ae91-831c6277df08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b33477-7de0-479c-ae91-831c6277df08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f16220-5009-42a0-80cd-a3fa7bc83944', 'volume_name': 'volume-d5f16220-5009-42a0-80cd-a3fa7bc83944', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e48cdca-2c10-4c2c-9095-1f9ec641009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e48cdca-2c10-4c2c-9095-1f9ec641009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc748af8-e208-49e8-b21a-5274efc1b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:56 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Volume d5f16220-5009-42a0-80cd-a3fa7bc83944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f16220-5009-42a0-80cd-a3fa7bc83944', 'volume_size': 1} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:56 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 Nov 02 12:01:56 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:56 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff440410-8053-425e-b69d-84e917005552" returned: 0 in 0.271s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff440410-8053-425e-b69d-84e917005552" released by "delete_volume" :: held 0.982s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Created reservations ['5319fd42-737d-46a9-b972-1e0243df0764', '7469d758-e2cf-4284-bf78-1513ac68b762', '5ca196b9-c16e-4271-9b18-2abf64cd3b61', '484801fb-6e58-4366-880c-7e41084ffec1'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:56 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:01:56 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:56 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" returned: 0 in 0.433s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:56 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c 1G Nov 02 12:01:56 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:56 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:56 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:01:56 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:01:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4bb8d0dc-1034-45ff-a3c2-e6a97f1f0da8 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-ff440410-8053-425e-b69d-84e917005552-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:01:57 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c 1G" returned: 0 in 0.496s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:57 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c Nov 02 12:01:57 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:57 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:57 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c is being set with open permissions: ugo+rw Nov 02 12:01:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:57 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c Nov 02 12:01:57 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:57 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c" returned: 0 in 0.251s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:57 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.info Nov 02 12:01:57 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:58 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.info" returned: 0 in 0.369s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:58 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.info is being set with open permissions: ugo+rw Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:58 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.info Nov 02 12:01:58 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (69f181c5-a4a5-4dae-bfe7-8334c94fc440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a09fa2-9a58-4669-b6ea-2347ee8f5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a09fa2-9a58-4669-b6ea-2347ee8f5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998386076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82943896-0be1-40ad-94f6-c42f2b9773d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:58Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f47261-7dd3-476b-aa73-da7c34eb7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f47261-7dd3-476b-aa73-da7c34eb7d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bcb19d-8284-4f67-a567-8a6ff897b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bcb19d-8284-4f67-a567-8a6ff897b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82943896-0be1-40ad-94f6-c42f2b9773d6', 'volume_name': 'volume-82943896-0be1-40ad-94f6-c42f2b9773d6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8239cde7-87b8-4982-a42a-9a5eb4c56cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8239cde7-87b8-4982-a42a-9a5eb4c56cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58df7bc5-4b09-441b-ac4c-ff776b745bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:58 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Volume 82943896-0be1-40ad-94f6-c42f2b9773d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82943896-0be1-40ad-94f6-c42f2b9773d6', 'volume_size': 1} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:58 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.info" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.180s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270383178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f16220-5009-42a0-80cd-a3fa7bc83944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3df77cd82a4afab7265b5f10da6b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:56Z,use_quota=True,user_id='259744e74b034c88ba6d6f6ffc82a9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Creating volume d5f16220-5009-42a0-80cd-a3fa7bc83944 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:58 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:58 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 1073741824 Nov 02 12:01:58 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:58 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d8bf8f68-46db-450d-b90e-5dc3f324a451 tempest-ProjectReaderTests-1253471065 None] Create snapshot completed successfully Nov 02 12:01:59 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 1073741824" returned: 0 in 0.489s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:59 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 Nov 02 12:01:59 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-3b485e58-c995-4383-aebc-53a3030e071c-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Lock "cinder-3b485e58-c995-4383-aebc-53a3030e071c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-3b485e58-c995-4383-aebc-53a3030e071c" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-3b485e58-c995-4383-aebc-53a3030e071c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Deleting offline snapshot 3b485e58-c995-4383-aebc-53a3030e071c of volume 2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] snapshot_file for this snap is: volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5b3dd4-4879-4387-b69f-7b3a7d39cef5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:59 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944" returned: 0 in 0.336s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.968s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998386076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82943896-0be1-40ad-94f6-c42f2b9773d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:01:58Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Creating volume 82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:01:59 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc748af8-e208-49e8-b21a-5274efc1b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f16220-5009-42a0-80cd-a3fa7bc83944', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:59 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 1073741824 Nov 02 12:01:59 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259894ee-b123-42aa-9230-053d2f713b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:01:59 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Volume volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 (d5f16220-5009-42a0-80cd-a3fa7bc83944): created successfully Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259894ee-b123-42aa-9230-053d2f713b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:01:59 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c Nov 02 12:01:59 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Flow 'volume_create_manager' (837b64b0-e0bc-416a-a4b9-c175dc03fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:01:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-13ea7872-61f2-4b0a-8702-5f87246ca380 tempest-ProjectReaderTests-714432677 None] Created volume successfully. Nov 02 12:01:59 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c" returned: 0 in 0.411s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b57870b-448b-412d-9dd1-d5db7ff0d579]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:01:59 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 Nov 02 12:01:59 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:01:59 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 02 12:01:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 1073741824" returned: 0 in 0.525s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:00 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 Nov 02 12:02:00 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:00 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" returned: 0 in 0.402s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:00 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c Nov 02 12:02:00 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:00 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6" returned: 0 in 0.317s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58df7bc5-4b09-441b-ac4c-ff776b745bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82943896-0be1-40ad-94f6-c42f2b9773d6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dea13d-df3e-4627-b5d7-546fba08b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:00 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Volume volume-82943896-0be1-40ad-94f6-c42f2b9773d6 (82943896-0be1-40ad-94f6-c42f2b9773d6): created successfully Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dea13d-df3e-4627-b5d7-546fba08b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (69f181c5-a4a5-4dae-bfe7-8334c94fc440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:00 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1f668e44-7c25-4c3a-81ce-843ac1f7675f tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Acquiring lock "cinder-d5f16220-5009-42a0-80cd-a3fa7bc83944-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Lock "cinder-d5f16220-5009-42a0-80cd-a3fa7bc83944-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Acquiring lock "cinder-quobyte-d5f16220-5009-42a0-80cd-a3fa7bc83944" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Lock "cinder-quobyte-d5f16220-5009-42a0-80cd-a3fa7bc83944" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41dcc48-1a95-42c2-9cc3-e7f0cd65c175]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:00 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c" returned: 0 in 0.485s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:00 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c Nov 02 12:02:00 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:00 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 Nov 02 12:02:00 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:01 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9.3b485e58-c995-4383-aebc-53a3030e071c" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-3b485e58-c995-4383-aebc-53a3030e071c" released by "_delete_snapshot" :: held 1.723s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" released by "delete_snapshot" :: held 1.757s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:01 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944" returned: 0 in 0.455s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:01 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944 Nov 02 12:02:01 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Created reservations ['046293cc-9a77-49cf-a802-f0cdaf9bd187', '660d6559-40d8-45b3-899a-d4603cc1c041', 'e37e6674-c993-43cb-b858-aca865335fc3', 'fbbd896f-cf67-4e52-ae05-166037cd2e4e'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Delete snapshot completed successfully. Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-84ddd8ff-e2b2-440d-93b7-9dd3e859ee2f tempest-ProjectReaderTests-1253471065 None] Lock "cinder-3b485e58-c995-4383-aebc-53a3030e071c-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:01 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d5f16220-5009-42a0-80cd-a3fa7bc83944" returned: 0 in 0.291s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Lock "cinder-quobyte-d5f16220-5009-42a0-80cd-a3fa7bc83944" released by "delete_volume" :: held 0.796s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Created reservations ['71cec15e-8ede-4a11-a258-f56ecd855258', '6d89e0ed-f692-49a5-a77e-98fad85bf0aa', 'bd5b9c3b-c34f-470c-920b-5cb4d8a93b27', '1e56581b-149f-4850-9aff-19a1e70841bd'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" acquired by "delete_volume" :: waited 0.035s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[322479d8-44a7-4c38-92d4-635922fab238]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:01 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:01 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:01 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 Nov 02 12:02:01 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 8fff332d-6c11-48dc-8795-63eee0216ac6 of volume 82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ec1ad-706a-49be-8b0d-e3302f8cf644]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:02 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 Nov 02 12:02:02 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:02 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.576s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Deleted volume successfully. Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-491ac0a5-b33e-44ec-a1c2-8b02557fe7e3 tempest-ProjectReaderTests-714432677 None] Lock "cinder-d5f16220-5009-42a0-80cd-a3fa7bc83944-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:02 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" returned: 0 in 0.726s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:02 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9 Nov 02 12:02:02 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:02 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6" returned: 0 in 0.740s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:02 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 1G Nov 02 12:02:02 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:02 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" returned: 0 in 0.392s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9" released by "delete_volume" :: held 1.221s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:02 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Created reservations ['9149768c-1c19-415e-85d2-31b5ebeb4357', 'b10b505f-56e2-4d0b-8a91-55cd62bf687a', 'b1732895-63cc-4657-be45-67d5bf07b6ba', '9afe31de-e9ad-46fb-83c4-a611eea6f0e6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:03 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:03 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:03 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 1G" returned: 0 in 0.575s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82943896-0be1-40ad-94f6-c42f2b9773d6 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:03 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82943896-0be1-40ad-94f6-c42f2b9773d6 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 Nov 02 12:02:03 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:03 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.346s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:03 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Deleted volume successfully. Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8c974d3c-633f-446b-84b9-cafa09b3add1 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-2f34f1d7-d877-4eaf-8fe4-e67fbe79f9d9-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:03 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82943896-0be1-40ad-94f6-c42f2b9773d6 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6" returned: 0 in 0.379s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:03 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 is being set with open permissions: ugo+rw Nov 02 12:02:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:03 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 Nov 02 12:02:03 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:04 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:04 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.info Nov 02 12:02:04 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (ab5cc28e-53fc-445a-9e29-0844bcf48472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f9c5ef-2f34-4b59-8af0-4b15bb17dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:04 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.info" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:04 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.info is being set with open permissions: ugo+rw Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f9c5ef-2f34-4b59-8af0-4b15bb17dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945195956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98873d67-295f-4020-8282-87e3503accec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:04Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01764c6-d736-4846-b375-7bc289119077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:04 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.info Nov 02 12:02:04 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01764c6-d736-4846-b375-7bc289119077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429a2b83-3d63-461a-9f38-b44c9b8bf1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429a2b83-3d63-461a-9f38-b44c9b8bf1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98873d67-295f-4020-8282-87e3503accec', 'volume_name': 'volume-98873d67-295f-4020-8282-87e3503accec', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1086ec29-6250-40a7-bf7b-fd5a904cfef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1086ec29-6250-40a7-bf7b-fd5a904cfef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586240d3-62a7-4808-8c9f-1b54ca1b1f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:04 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Volume 98873d67-295f-4020-8282-87e3503accec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98873d67-295f-4020-8282-87e3503accec', 'volume_size': 1} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:04 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.info" returned: 0 in 0.295s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.260s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945195956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98873d67-295f-4020-8282-87e3503accec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:04Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Creating volume 98873d67-295f-4020-8282-87e3503accec {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:04 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:04 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec 1073741824 Nov 02 12:02:04 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a9aa45a0-5b00-4fd8-86b6-6a8bd798d764 tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-8fff332d-6c11-48dc-8795-63eee0216ac6-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-8fff332d-6c11-48dc-8795-63eee0216ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-82943896-0be1-40ad-94f6-c42f2b9773d6" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-82943896-0be1-40ad-94f6-c42f2b9773d6" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-8fff332d-6c11-48dc-8795-63eee0216ac6" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8fff332d-6c11-48dc-8795-63eee0216ac6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 8fff332d-6c11-48dc-8795-63eee0216ac6 of volume 82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[549db5da-574c-421d-af29-7f86b2098af2]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:05 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 Nov 02 12:02:05 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:05 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec 1073741824" returned: 0 in 0.718s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:05 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec Nov 02 12:02:05 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:05 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6" returned: 0 in 0.533s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82943896-0be1-40ad-94f6-c42f2b9773d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcf894f-eaf6-4ed3-8c3b-678bfaf3c4a5]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:05 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586240d3-62a7-4808-8c9f-1b54ca1b1f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98873d67-295f-4020-8282-87e3503accec', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff69fe0-2d21-4638-967b-f091d95dd2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:05 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Volume volume-98873d67-295f-4020-8282-87e3503accec (98873d67-295f-4020-8282-87e3503accec): created successfully Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff69fe0-2d21-4638-967b-f091d95dd2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:05 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (ab5cc28e-53fc-445a-9e29-0844bcf48472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:05 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dd8dceea-e8da-4775-97ac-3b074f8cb557 tempest-ProjectReaderTests-1253471065 None] Created volume successfully. Nov 02 12:02:06 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 Nov 02 12:02:06 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:06 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6" returned: 0 in 0.538s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:06 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 Nov 02 12:02:06 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Creating offline snapshot a373fbbc-58d3-469a-83e2-b413e5588b32 of volume 98873d67-295f-4020-8282-87e3503accec {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b18e10-ba3f-45ec-9a44-6e1e936f8224]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:06 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec Nov 02 12:02:06 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:06 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6" returned: 0 in 0.594s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:07 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6 Nov 02 12:02:07 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:07 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec" returned: 0 in 0.519s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:07 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6.8fff332d-6c11-48dc-8795-63eee0216ac6" returned: 0 in 0.328s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:07 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 1G Nov 02 12:02:07 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-8fff332d-6c11-48dc-8795-63eee0216ac6" released by "_delete_snapshot" :: held 2.154s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-82943896-0be1-40ad-94f6-c42f2b9773d6" released by "delete_snapshot" :: held 2.195s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Created reservations ['508460a8-a63a-4ab5-a388-e9cde5a2a0e7', 'f809d368-b214-43f6-8787-9d1a6ea0d810', 'a9eb334f-6e09-49ec-a53b-20f75a350fa9', 'e83ca1d9-b5e2-4da9-8492-9f77b727eca4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:07 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-42833033-21cb-4599-9086-ea869b956a29 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-8fff332d-6c11-48dc-8795-63eee0216ac6-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:07 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 1G" returned: 0 in 0.568s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98873d67-295f-4020-8282-87e3503accec -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:07 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98873d67-295f-4020-8282-87e3503accec -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 Nov 02 12:02:07 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:08 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98873d67-295f-4020-8282-87e3503accec -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:08 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 is being set with open permissions: ugo+rw Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:08 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 Nov 02 12:02:08 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-82943896-0be1-40ad-94f6-c42f2b9773d6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Lock "cinder-82943896-0be1-40ad-94f6-c42f2b9773d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-82943896-0be1-40ad-94f6-c42f2b9773d6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-82943896-0be1-40ad-94f6-c42f2b9773d6" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3626404-6194-44e0-9611-d55bda5e5ac1]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:08 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:08 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.info Nov 02 12:02:08 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:08 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 Nov 02 12:02:08 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:08 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.info" returned: 0 in 0.350s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:08 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.info is being set with open permissions: ugo+rw Nov 02 12:02:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:09 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.info Nov 02 12:02:09 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:09 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6" returned: 0 in 0.537s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:09 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6 Nov 02 12:02:09 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:09 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.info" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:09 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-82943896-0be1-40ad-94f6-c42f2b9773d6" returned: 0 in 0.303s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-e5031ffe-7c37-4db5-a0c4-834541548386 tempest-ProjectReaderTests-1253471065 None] Create snapshot completed successfully Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-82943896-0be1-40ad-94f6-c42f2b9773d6" released by "delete_volume" :: held 0.939s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Created reservations ['885fd73e-c87c-4b87-83c9-971bdb4d3479', 'eeaf8b3a-7625-49ca-b405-01d504cacbf8', '3066057a-efaa-4e04-9d8a-ee3d9dbd7e88', '00546bcb-190f-4c7a-87bc-09d443ee1aa0'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:09 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:09 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.343s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:09 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:09 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:09 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3994e578-9824-493e-a299-4597f9744fdc tempest-ProjectMemberTests-1390221521 None] Lock "cinder-82943896-0be1-40ad-94f6-c42f2b9773d6-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-a373fbbc-58d3-469a-83e2-b413e5588b32-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Lock "cinder-a373fbbc-58d3-469a-83e2-b413e5588b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-98873d67-295f-4020-8282-87e3503accec" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-98873d67-295f-4020-8282-87e3503accec" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-a373fbbc-58d3-469a-83e2-b413e5588b32" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-a373fbbc-58d3-469a-83e2-b413e5588b32" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Deleting offline snapshot a373fbbc-58d3-469a-83e2-b413e5588b32 of volume 98873d67-295f-4020-8282-87e3503accec {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] snapshot_file for this snap is: volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811d90b-2e13-4d06-a799-34414b6416c8]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:10 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 Nov 02 12:02:10 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (c78183e6-875f-4bf6-8f79-4a0b2fe023c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54e0f2d-a856-4767-8d3c-e86ae795b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54e0f2d-a856-4767-8d3c-e86ae795b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328122689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1786cf3-7da0-45fa-add9-a984bcf2c5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:10Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9b8da5-9ff7-498e-9173-64968fd20846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9b8da5-9ff7-498e-9173-64968fd20846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cf99c8-71a1-4657-8141-03e70c1613e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cf99c8-71a1-4657-8141-03e70c1613e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1786cf3-7da0-45fa-add9-a984bcf2c5bb', 'volume_name': 'volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45352533-51ae-4520-982f-faaf592694ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45352533-51ae-4520-982f-faaf592694ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40897769-2144-4dbc-82f5-941518377b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:10 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Volume a1786cf3-7da0-45fa-add9-a984bcf2c5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb', 'volume_size': 1} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328122689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1786cf3-7da0-45fa-add9-a984bcf2c5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:10Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Creating volume a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:10 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:10 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb 1073741824 Nov 02 12:02:10 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:10 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98873d67-295f-4020-8282-87e3503accec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[267a62d0-d1ea-433d-8fa6-88fc73339bb3]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:10 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:10 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec Nov 02 12:02:10 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:11 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb 1073741824" returned: 0 in 0.657s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:11 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec" returned: 0 in 0.515s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:11 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 Nov 02 12:02:11 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:11 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb Nov 02 12:02:11 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:11 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40897769-2144-4dbc-82f5-941518377b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6d6715-0549-4138-9344-d41564b9afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Volume volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb (a1786cf3-7da0-45fa-add9-a984bcf2c5bb): created successfully Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6d6715-0549-4138-9344-d41564b9afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (c78183e6-875f-4bf6-8f79-4a0b2fe023c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:11 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:11 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-37b2bfb8-06be-4c0a-95ec-d5772bce294a tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32" returned: 0 in 0.434s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:11 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32 Nov 02 12:02:11 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Flow 'volume_create_manager' (39f5ce95-570f-455e-acee-2b79fdd047c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191b831c-244c-42fb-a92e-1369a9bdbb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191b831c-244c-42fb-a92e-1369a9bdbb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-544817285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c72bdfda0d4b7890105b4155ea20c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:12Z,use_quota=True,user_id='236ed0b8929c47fbb5380e16dbc741dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380bceec-5b7c-4ad2-bf35-da18745c215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380bceec-5b7c-4ad2-bf35-da18745c215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade675bd-66d0-4f62-8b27-d9715e7cce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade675bd-66d0-4f62-8b27-d9715e7cce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e', 'volume_name': 'volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c271a024-e262-42b6-acdc-8f36ea82fb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c271a024-e262-42b6-acdc-8f36ea82fb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65eb2df8-9665-46e9-9a71-de5e1d8d13ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:11 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Volume 7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e', 'volume_size': 1} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-544817285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c72bdfda0d4b7890105b4155ea20c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:12Z,use_quota=True,user_id='236ed0b8929c47fbb5380e16dbc741dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Creating volume 7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:11 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:11 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:12 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec.a373fbbc-58d3-469a-83e2-b413e5588b32" returned: 0 in 0.283s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:12 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e 1073741824 Nov 02 12:02:12 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-a373fbbc-58d3-469a-83e2-b413e5588b32" released by "_delete_snapshot" :: held 1.908s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-98873d67-295f-4020-8282-87e3503accec" released by "delete_snapshot" :: held 1.935s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Created reservations ['de2b27dd-924c-495a-ac6a-a63701dc5013', '5530bfc3-da97-4c10-8202-f94c3670cdc3', '73756413-7d92-45df-87a5-7fb512413b0e', '96de9592-b66f-4530-818d-5333b0ac558f'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Delete snapshot completed successfully. Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-10e26eff-3514-454f-8dda-6fe54b24060c tempest-ProjectReaderTests-1253471065 None] Lock "cinder-a373fbbc-58d3-469a-83e2-b413e5588b32-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-98873d67-295f-4020-8282-87e3503accec-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-98873d67-295f-4020-8282-87e3503accec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-98873d67-295f-4020-8282-87e3503accec" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-98873d67-295f-4020-8282-87e3503accec" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efc1837-2b99-4891-8a92-c08b72b67ffd]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:12 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e 1073741824" returned: 0 in 0.503s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:12 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e Nov 02 12:02:12 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:12 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec Nov 02 12:02:12 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:12 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" returned: 0 in 0.305s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.086s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:12 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65eb2df8-9665-46e9-9a71-de5e1d8d13ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511b12b5-c791-4594-bdf6-723b68c67af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 5e3e19a5-7ad4-448a-beff-5238fea85512 of volume a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec" returned: 0 in 0.420s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8248d7-20ea-4cf5-8e84-b5c2e7ac6eb0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:12 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec Nov 02 12:02:12 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Volume volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e (7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e): created successfully Nov 02 12:02:12 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511b12b5-c791-4594-bdf6-723b68c67af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:12 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Flow 'volume_create_manager' (39f5ce95-570f-455e-acee-2b79fdd047c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:12 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6e9f3d6a-b8f6-42cf-8a92-d326b5deda0f tempest-SnapshotDependencyTests-1982104676 None] Created volume successfully. Nov 02 12:02:13 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb Nov 02 12:02:13 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:13 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-98873d67-295f-4020-8282-87e3503accec" returned: 0 in 0.256s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-98873d67-295f-4020-8282-87e3503accec" released by "delete_volume" :: held 0.746s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Created reservations ['7b088b68-bb0e-4865-9f07-4404c8e02efd', '0f25b843-74cf-4d6d-803a-7eaf38d1b786', '2d85df7a-06c4-4b60-9940-ac6a452b4e51', '9cde3b7d-b7a3-48e5-aebc-13d309790378'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:13 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" returned: 0 in 0.391s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:13 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:13 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:13 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 1G Nov 02 12:02:13 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:13 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:13 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Deleted volume successfully. Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-53a6d21d-63dd-49a8-8b08-4fddce916413 tempest-ProjectReaderTests-1253471065 None] Lock "cinder-98873d67-295f-4020-8282-87e3503accec-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:13 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 1G" returned: 0 in 0.437s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:13 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 Nov 02 12:02:13 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:13 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (c354de73-d8a9-4a32-9d56-81b50c48a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6897bd-2d2f-4ef7-a75a-027871367acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6897bd-2d2f-4ef7-a75a-027871367acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2061952411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde4e1d2-85d8-49c4-b7c5-9e697db9cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:14Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea19c24e-65dc-4c09-ba22-e11a73281a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea19c24e-65dc-4c09-ba22-e11a73281a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22854150-4851-4bc1-aed3-11ebed4225ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22854150-4851-4bc1-aed3-11ebed4225ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde4e1d2-85d8-49c4-b7c5-9e697db9cc86', 'volume_name': 'volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31c3669-bc22-4622-bf20-452d5a84798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31c3669-bc22-4622-bf20-452d5a84798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21710fe-f3eb-4559-a3cd-fe85c934859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:14 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:14 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Volume dde4e1d2-85d8-49c4-b7c5-9e697db9cc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86', 'volume_size': 1} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512" returned: 0 in 0.361s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 is being set with open permissions: ugo+rw Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:14 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 Nov 02 12:02:14 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:14 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:14 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.info Nov 02 12:02:14 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:14 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.info" returned: 0 in 0.254s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:14 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.info is being set with open permissions: ugo+rw Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:14 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.info Nov 02 12:02:14 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:14 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.info" returned: 0 in 0.238s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2061952411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde4e1d2-85d8-49c4-b7c5-9e697db9cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bc25a2dc3341b5936ba41d8138761e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:14Z,use_quota=True,user_id='24193eeb22134937bd7f6accaa9e8a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Creating volume dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:14 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:14 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:14 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 1073741824 Nov 02 12:02:14 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:14 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8dfe7763-16d9-4940-917a-f3154c91593e tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:02:15 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 1073741824" returned: 0 in 0.421s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:15 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 Nov 02 12:02:15 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:15 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.580s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21710fe-f3eb-4559-a3cd-fe85c934859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f8346c-3578-4821-b2a7-9a5183499a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Creating offline snapshot 3c14c303-5671-4def-ae8b-63d7382232bb of volume 7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-5e3e19a5-7ad4-448a-beff-5238fea85512-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:15 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Volume volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 (dde4e1d2-85d8-49c4-b7c5-9e697db9cc86): created successfully Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f8346c-3578-4821-b2a7-9a5183499a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Flow 'volume_create_manager' (c354de73-d8a9-4a32-9d56-81b50c48a827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5593f0aa-7abc-4656-92ea-9b9aa5d6fbeb]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Lock "cinder-5e3e19a5-7ad4-448a-beff-5238fea85512-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:15 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:15 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2b9637ff-1d48-42f7-9906-9199e4222648 tempest-ProjectReaderTests-1253471065 None] Created volume successfully. Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-5e3e19a5-7ad4-448a-beff-5238fea85512" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-5e3e19a5-7ad4-448a-beff-5238fea85512" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 5e3e19a5-7ad4-448a-beff-5238fea85512 of volume a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[775de3ed-494c-428a-8623-9c1a477db7f6]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:16 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e Nov 02 12:02:16 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:16 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 Nov 02 12:02:16 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:16 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" returned: 0 in 0.435s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:16 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb 1G Nov 02 12:02:16 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:16 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512" returned: 0 in 0.403s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e324e3f-63e5-4290-a919-3cd5dfb666c0]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:16 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb Nov 02 12:02:16 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:16 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb 1G" returned: 0 in 0.408s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:16 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb Nov 02 12:02:16 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:16 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" returned: 0 in 0.383s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:16 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:16 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 Nov 02 12:02:16 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:17 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb" returned: 0 in 0.297s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:17 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb is being set with open permissions: ugo+rw Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:17 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb Nov 02 12:02:17 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:17 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:17 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512 Nov 02 12:02:17 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:17 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:17 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.info Nov 02 12:02:17 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:17 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb.5e3e19a5-7ad4-448a-beff-5238fea85512" returned: 0 in 0.275s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-5e3e19a5-7ad4-448a-beff-5238fea85512" released by "_delete_snapshot" :: held 1.537s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" released by "delete_snapshot" :: held 1.559s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Created reservations ['8002c6c5-907d-4229-a5ad-13aaf4560fe6', 'e77e4c98-788f-49ab-85a3-c7f33e19c8b5', '519a9ceb-6a12-4939-ae68-dc8a993ea6b8', 'a8f91fef-55ea-4807-8fe4-a0f638039e0d'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:17 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.info" returned: 0 in 0.274s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:17 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.info is being set with open permissions: ugo+rw Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:17 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.info Nov 02 12:02:17 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-9a4a7ce0-1c57-4a26-8a14-827b19d86e3e tempest-ProjectMemberTests-1390221521 None] Lock "cinder-5e3e19a5-7ad4-448a-beff-5238fea85512-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:17 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.info" returned: 0 in 0.241s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.637s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Creating offline snapshot 7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a of volume dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:17 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-61ec9405-366e-407c-8d1a-1de83480cc48 tempest-SnapshotDependencyTests-1982104676 None] Create snapshot completed successfully Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568da1d-4d05-49ce-8ece-591a9b2a83ee]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:17 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-a1786cf3-7da0-45fa-add9-a984bcf2c5bb-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:18 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 Nov 02 12:02:18 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-a1786cf3-7da0-45fa-add9-a984bcf2c5bb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb415996-7566-4a1b-8fa8-ce59e0529a7f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:18 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb Nov 02 12:02:18 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:18 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" returned: 0 in 0.412s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:18 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a 1G Nov 02 12:02:18 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:18 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" returned: 0 in 0.401s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:18 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb Nov 02 12:02:18 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:18 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a 1G" returned: 0 in 0.447s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:18 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a Nov 02 12:02:18 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:18 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" returned: 0 in 0.293s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-a1786cf3-7da0-45fa-add9-a984bcf2c5bb" released by "delete_volume" :: held 0.778s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:19 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:19 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Created reservations ['80a0ec57-3bea-46e0-80e3-1720c2bce507', 'e08b000b-4eea-4647-bcab-a795c04cb2ba', '9db83094-21ef-44ec-97a5-000aa2637d19', '77e0842e-d04d-4668-8e4d-72a6842a2990'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:19 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Flow 'volume_create_manager' (b1d89d67-1dcd-4482-9700-17895e4aabf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:19 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ed60be-155e-4b7d-ae12-d4a21bbf32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" returned: 0 in 0.424s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a is being set with open permissions: ugo+rw Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ed60be-155e-4b7d-ae12-d4a21bbf32c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95af1d8f-3a98-4f12-9f1e-192e9994fcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c72bdfda0d4b7890105b4155ea20c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3c14c303-5671-4def-ae8b-63d7382232bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:19Z,use_quota=True,user_id='236ed0b8929c47fbb5380e16dbc741dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd58361d-8269-4284-b54c-0ae876a66bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a Nov 02 12:02:19 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd58361d-8269-4284-b54c-0ae876a66bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23d2d0e-10a6-4a9c-99eb-bad47a2ee026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23d2d0e-10a6-4a9c-99eb-bad47a2ee026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95af1d8f-3a98-4f12-9f1e-192e9994fcb2', 'volume_name': 'volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2', 'volume_size': 1, 'snapshot_id': '3c14c303-5671-4def-ae8b-63d7382232bb'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e771c5-f609-4e56-b381-cb1ec6a7d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e771c5-f609-4e56-b381-cb1ec6a7d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73f60f1-c204-4e16-a519-513d0248d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Volume 95af1d8f-3a98-4f12-9f1e-192e9994fcb2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2', 'volume_size': 1, 'snapshot_id': '3c14c303-5671-4def-ae8b-63d7382232bb'} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.405s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:02:19 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:19 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-3d37fdf2-0ab7-4c66-b9a4-579cf52a4a70 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-a1786cf3-7da0-45fa-add9-a984bcf2c5bb-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:19 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" returned: 0 in 0.334s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:19 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.info Nov 02 12:02:19 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (aa2d6f42-faed-40b5-bf16-500a588a9320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28640dfc-95a9-4954-b268-f1e2e512d32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28640dfc-95a9-4954-b268-f1e2e512d32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068016015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2eb3f3-d2ce-4c28-8c60-956feb964d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:20Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac5ab3-221d-4168-a9b7-8629dd2b33e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac5ab3-221d-4168-a9b7-8629dd2b33e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2556a7f-ac42-4909-a22d-84670b011ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2556a7f-ac42-4909-a22d-84670b011ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2eb3f3-d2ce-4c28-8c60-956feb964d22', 'volume_name': 'volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879b44f5-1e30-47c9-bfc2-7c1affde6862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879b44f5-1e30-47c9-bfc2-7c1affde6862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df360389-836c-4974-91ee-c8f92f389cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:19 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Volume be2eb3f3-d2ce-4c28-8c60-956feb964d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22', 'volume_size': 1} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.info" returned: 0 in 0.296s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:19 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.info is being set with open permissions: ugo+rw Nov 02 12:02:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:19 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.info Nov 02 12:02:19 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:20 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.info" returned: 0 in 0.245s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.808s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-quobyte-3c14c303-5671-4def-ae8b-63d7382232bb-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" by "_create_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-3c14c303-5671-4def-ae8b-63d7382232bb-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Creating volume 95af1d8f-3a98-4f12-9f1e-192e9994fcb2 from snapshot 3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-quobyte-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" by "_copy_volume_from_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:20 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-42d49fd8-2139-4cc3-8ccd-28b682f36637 tempest-ProjectReaderTests-1253471065 None] Create snapshot completed successfully Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] snapshot: 3c14c303-5671-4def-ae8b-63d7382232bb, volume: 95af1d8f-3a98-4f12-9f1e-192e9994fcb2, {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7219ecf-53a0-4a0d-81f5-8e66d280b085]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:20 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb Nov 02 12:02:20 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Lock "cinder-7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Deleting offline snapshot 7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a of volume dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] snapshot_file for this snap is: volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4282ae-4926-4817-9fe0-05f93a2520c3]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:20 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9c7b07-2780-40ba-a45c-bce711ee26be]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:20 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a Nov 02 12:02:20 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:20 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e Nov 02 12:02:20 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:20 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" returned: 0 in 0.375s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:20 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac31a2-de88-4d55-bc93-30716b05b4cf]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:21 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" returned: 0 in 0.381s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Creating direct copy from snapshot {{(pid=86846) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG cinder.utils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Path /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 not found in is_blk_device check {{(pid=86846) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:21 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 Nov 02 12:02:21 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:21 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 Nov 02 12:02:21 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:21 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" returned: 0 in 0.372s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:21 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a Nov 02 12:02:21 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:21 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" returned: 0 in 0.557s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:21 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:21 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a Nov 02 12:02:21 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:22 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86.7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" returned: 0 in 0.330s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a" released by "_delete_snapshot" :: held 1.760s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" released by "delete_snapshot" :: held 1.791s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Created reservations ['85fdf455-ed42-4ef5-a3a3-3d877a0de770', 'e0292236-7cc0-4c94-8f2a-ad8774c90c7e', 'df5e4dbb-e960-49fd-90f6-68d915b5b08b', '9c33f6e4-6525-4d37-a168-9c750546eab4'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Delete snapshot completed successfully. Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-4d4ee8a8-96ee-444b-89d3-eb31a5af219d tempest-ProjectReaderTests-1253471065 None] Lock "cinder-7cf57ec3-b1b5-4e41-9368-4b5e46e30b0a-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Lock "cinder-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Acquiring lock "cinder-quobyte-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" acquired by "delete_volume" :: waited 0.024s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6a4f2-8564-406f-8436-ebf66cec39ab]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:23 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 Nov 02 12:02:23 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:23 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" returned: 0 in 0.641s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:23 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86 Nov 02 12:02:23 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:24 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" returned: 0 in 0.467s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Lock "cinder-quobyte-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86" released by "delete_volume" :: held 1.263s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Created reservations ['4c13bdae-9229-42dc-992e-c7a2ecc1e18f', 'a543d506-f775-4166-8f83-f9cf664956a6', '1f24893e-5619-4d52-884e-5e9fcf921e5c', '8808fd44-4f2c-4510-ba12-976581f11019'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:24 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:24 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:24 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.322s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Deleted volume successfully. Nov 02 12:02:24 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-eb8f7a3b-d764-481e-b599-1d6c18beb5ce tempest-ProjectReaderTests-1253471065 None] Lock "cinder-dde4e1d2-85d8-49c4-b7c5-9e697db9cc86-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:27 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" returned: 0 in 6.717s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:27 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 {{(pid=86846) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:02:27 devstack cinder-volume[86846]: INFO cinder.image.image_utils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Converted 1024.00 MB image at 152.42 MB/s Nov 02 12:02:27 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 is being set with open permissions: ugo+rw Nov 02 12:02:27 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:27 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 Nov 02 12:02:27 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:28 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" returned: 0 in 0.270s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" released by "_copy_volume_from_snapshot" :: held 7.812s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-3c14c303-5671-4def-ae8b-63d7382232bb-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" released by "_create_volume_from_snapshot" :: held 7.878s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.902s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.174s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068016015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2eb3f3-d2ce-4c28-8c60-956feb964d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:20Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Creating volume be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:28 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:28 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 1073741824 Nov 02 12:02:28 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73f60f1-c204-4e16-a519-513d0248d29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2', 'volume_size': 1, 'snapshot_id': '3c14c303-5671-4def-ae8b-63d7382232bb'}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca484a6-9b0e-4c50-ab91-9d1e59630622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Volume volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 (95af1d8f-3a98-4f12-9f1e-192e9994fcb2): created successfully Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca484a6-9b0e-4c50-ab91-9d1e59630622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Flow 'volume_create_manager' (b1d89d67-1dcd-4482-9700-17895e4aabf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-21d096a8-fab2-4b5a-9e24-d6f1a705a1d7 tempest-SnapshotDependencyTests-1982104676 None] Created volume successfully. Nov 02 12:02:28 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 1073741824" returned: 0 in 0.442s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:28 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 Nov 02 12:02:28 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:28 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22" returned: 0 in 0.238s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df360389-836c-4974-91ee-c8f92f389cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69ab4ae-e000-498f-823d-c76162200129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:28 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Volume volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 (be2eb3f3-d2ce-4c28-8c60-956feb964d22): created successfully Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69ab4ae-e000-498f-823d-c76162200129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:28 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (aa2d6f42-faed-40b5-bf16-500a588a9320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:28 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c0f6acda-06bf-4c64-89e3-7e6fdc083610 tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-3c14c303-5671-4def-ae8b-63d7382232bb-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-3c14c303-5671-4def-ae8b-63d7382232bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-quobyte-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-quobyte-3c14c303-5671-4def-ae8b-63d7382232bb" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-3c14c303-5671-4def-ae8b-63d7382232bb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Deleting offline snapshot 3c14c303-5671-4def-ae8b-63d7382232bb of volume 7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] snapshot_file for this snap is: volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78157fd-eefb-42d0-b7b7-39b6a7b138db]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:29 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb Nov 02 12:02:29 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:29 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb" returned: 0 in 0.378s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[6093b2e4-9944-488b-a00e-fddd429c3320]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:29 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e Nov 02 12:02:29 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 of volume be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc1613-e400-4598-b591-6851e8914db7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:29 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 Nov 02 12:02:29 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:30 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" returned: 0 in 0.609s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:30 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb Nov 02 12:02:30 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:30 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22" returned: 0 in 0.412s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:30 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 1G Nov 02 12:02:30 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:30 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb" returned: 0 in 0.401s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:30 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb Nov 02 12:02:30 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:30 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 1G" returned: 0 in 0.509s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:30 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 Nov 02 12:02:30 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:30 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e.3c14c303-5671-4def-ae8b-63d7382232bb" returned: 0 in 0.275s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-3c14c303-5671-4def-ae8b-63d7382232bb" released by "_delete_snapshot" :: held 1.818s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" released by "delete_snapshot" :: held 1.844s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:30 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Created reservations ['ce4f059d-9262-4505-9d17-e70f2202ec6f', '6118b9d0-bf95-4ed8-9be1-8182bc4f5355', '81c5aede-a8be-42b7-b1a2-637963bcaea0', '93c0b072-7287-4f86-8f00-9e0cd49ed9de'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:31 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Delete snapshot completed successfully. Nov 02 12:02:31 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:31 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 is being set with open permissions: ugo+rw Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-2b7fafbe-f364-4c33-99ad-b8a2dc494e1e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-3c14c303-5671-4def-ae8b-63d7382232bb-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:31 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 Nov 02 12:02:31 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-quobyte-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:31 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" returned: 0 in 0.294s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd1d42-d2ff-4838-9b3f-24d8d1fe697b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:31 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.info Nov 02 12:02:31 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:31 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e Nov 02 12:02:31 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:31 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.info" returned: 0 in 0.287s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:31 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.info is being set with open permissions: ugo+rw Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:31 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.info Nov 02 12:02:31 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:31 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" returned: 0 in 0.508s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:31 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:31 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e Nov 02 12:02:31 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:32 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.info" returned: 0 in 0.323s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5a74ab94-d73e-4551-88d9-4c5eca067b9f tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:02:32 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" returned: 0 in 0.269s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e" released by "delete_volume" :: held 0.855s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Created reservations ['28a97087-b9a4-4b7d-9e26-ab13a9ec74b4', 'd8134f29-ef9d-42ac-be17-d3847cf6bba4', 'a45670aa-eeb1-4435-b971-408a64cb09d6', 'ab1d9f77-5948-42b7-80b5-ee0791a59781'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:32 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:32 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-95af1d8f-3a98-4f12-9f1e-192e9994fcb2-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-95af1d8f-3a98-4f12-9f1e-192e9994fcb2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "cinder-quobyte-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3513a33-4373-4b42-9dcd-80091af498a7]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:32 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.338s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:32 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Deleted volume successfully. Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d98d7089-c3b9-46aa-93e5-5eaedd83dfd1 tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-7c2c566e-46b3-4a41-b6e8-fe8444dc6f1e-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:32 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 Nov 02 12:02:32 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:32 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-be2eb3f3-d2ce-4c28-8c60-956feb964d22" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:33 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" returned: 0 in 0.453s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-be2eb3f3-d2ce-4c28-8c60-956feb964d22" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:33 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2 Nov 02 12:02:33 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 of volume be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf864d-09b7-44be-8064-577e6395c349]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:33 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 Nov 02 12:02:33 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:33 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-quobyte-95af1d8f-3a98-4f12-9f1e-192e9994fcb2" released by "delete_volume" :: held 0.780s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Created reservations ['47839c94-ffae-42ff-b4e5-7c2b52800304', 'a065e023-ff8b-48bc-ae75-c5e9116a51dd', '61ffbe42-f9ae-4c90-b081-4b7d613e7a71', '2167ae0a-b353-4a30-9bde-d11fd7361f45'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:33 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:33 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:33 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" returned: 0 in 0.413s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[646c67a6-b2c5-480b-868c-1cf9c49cc51f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:33 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 Nov 02 12:02:33 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:33 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.281s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:33 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Deleted volume successfully. Nov 02 12:02:33 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-25e49f49-c3b2-4b10-bf4f-afed5c596b4e tempest-SnapshotDependencyTests-1982104676 None] Lock "cinder-95af1d8f-3a98-4f12-9f1e-192e9994fcb2-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:34 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22" returned: 0 in 0.472s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:34 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 Nov 02 12:02:34 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:34 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:34 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6 Nov 02 12:02:34 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:34 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22.87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" returned: 0 in 0.283s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6" released by "_delete_snapshot" :: held 1.739s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-be2eb3f3-d2ce-4c28-8c60-956feb964d22" released by "delete_snapshot" :: held 1.772s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Created reservations ['bb8d24d5-8ffe-4b4a-864f-ea5ffd3752a5', '2b13fd37-a45a-4999-b81c-39e14a2c085c', '8a44a244-a3bb-4d67-a501-772e63cf9511', 'ab8846af-e8ca-44e4-abac-1cbb265ef42b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:34 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:02:34 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-d348290e-e20c-46fd-8cba-ec413f941ba9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-87aa4fe7-50cf-42e8-86ac-ca0d025d1ec6-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-be2eb3f3-d2ce-4c28-8c60-956feb964d22-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-be2eb3f3-d2ce-4c28-8c60-956feb964d22-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-be2eb3f3-d2ce-4c28-8c60-956feb964d22" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-be2eb3f3-d2ce-4c28-8c60-956feb964d22" acquired by "delete_volume" :: waited 0.022s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c0a61-3fb5-4ae4-8947-3bd60e8ade82]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:35 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 Nov 02 12:02:35 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:35 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22" returned: 0 in 0.423s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:35 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22 Nov 02 12:02:35 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (de19473e-5596-423b-a371-5bb6cca7cd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df4387e-20ef-4cb6-b46e-52dad291f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=187,cinder:UPDATE=232,cinder:DELETE=20,cinder:INSERT=61 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df4387e-20ef-4cb6-b46e-52dad291f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1151294238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c5f41-d554-433b-b54e-12d472a09bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:36Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b6672d-dde0-4f6e-aa95-6ec21d394bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b6672d-dde0-4f6e-aa95-6ec21d394bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229602a5-d9e1-4be4-a243-254e48516482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229602a5-d9e1-4be4-a243-254e48516482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2c5f41-d554-433b-b54e-12d472a09bd6', 'volume_name': 'volume-af2c5f41-d554-433b-b54e-12d472a09bd6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9584cd6-d691-40f0-a663-233fcae17e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9584cd6-d691-40f0-a663-233fcae17e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dd8205-2e19-4b08-a293-e12cd8b95b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:35 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Volume af2c5f41-d554-433b-b54e-12d472a09bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2c5f41-d554-433b-b54e-12d472a09bd6', 'volume_size': 1} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1151294238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c5f41-d554-433b-b54e-12d472a09bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:36Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Creating volume af2c5f41-d554-433b-b54e-12d472a09bd6 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:35 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:35 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:35 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 1073741824 Nov 02 12:02:35 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:36 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-be2eb3f3-d2ce-4c28-8c60-956feb964d22" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-be2eb3f3-d2ce-4c28-8c60-956feb964d22" released by "delete_volume" :: held 0.829s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:DELETE=17,cinder:INSERT=58,cinder:UPDATE=207,cinder:SELECT=161 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Created reservations ['66ec903a-fcee-440f-8082-3ac6dccdbf2e', 'e6b27132-eedd-43cf-9e18-953130aa4cdf', 'e773c301-755d-4bb2-bee9-500bdb0386a7', '15878dfc-4a67-4185-8726-88fcbccef065'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:36 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:36 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:36 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 1073741824" returned: 0 in 0.609s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:36 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.327s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:36 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-882a934f-4737-421f-af93-22ec67914c1a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-be2eb3f3-d2ce-4c28-8c60-956feb964d22-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:36 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 Nov 02 12:02:36 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:36 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6" returned: 0 in 0.299s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dd8205-2e19-4b08-a293-e12cd8b95b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2c5f41-d554-433b-b54e-12d472a09bd6', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb34225-b4ad-4f36-b79f-2e2417daa9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (6a616a77-a656-441a-a6e5-939e3cc183bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6019194b-5f30-44f4-85b5-6b0110781b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:36 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Volume volume-af2c5f41-d554-433b-b54e-12d472a09bd6 (af2c5f41-d554-433b-b54e-12d472a09bd6): created successfully Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb34225-b4ad-4f36-b79f-2e2417daa9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:36 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (de19473e-5596-423b-a371-5bb6cca7cd3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6019194b-5f30-44f4-85b5-6b0110781b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979347615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74430653-c391-48b2-989c-d778687ed4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:37Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b8d8a8-978b-402d-97fa-f3576e36726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b8d8a8-978b-402d-97fa-f3576e36726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca74ae8-18f3-4de4-99cd-64be656a4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca74ae8-18f3-4de4-99cd-64be656a4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74430653-c391-48b2-989c-d778687ed4fb', 'volume_name': 'volume-74430653-c391-48b2-989c-d778687ed4fb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570d4766-fa79-4cff-be44-a281090d71ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570d4766-fa79-4cff-be44-a281090d71ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc86aac1-0ece-4812-b2cf-1e5d70e15eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Volume 74430653-c391-48b2-989c-d778687ed4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74430653-c391-48b2-989c-d778687ed4fb', 'volume_size': 1} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979347615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74430653-c391-48b2-989c-d778687ed4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:37Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Creating volume 74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:37 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-a597ae88-c1f2-4152-9a8a-dc5544910e27 tempest-ProjectReaderTests-1026918808 None] Created volume successfully. Nov 02 12:02:37 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb 1073741824 Nov 02 12:02:37 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:37 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb 1073741824" returned: 0 in 0.474s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:37 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb Nov 02 12:02:37 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:37 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb" returned: 0 in 0.266s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc86aac1-0ece-4812-b2cf-1e5d70e15eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74430653-c391-48b2-989c-d778687ed4fb', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcdfaa1-7a02-4f65-81cc-953f09d0a137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:37 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Volume volume-74430653-c391-48b2-989c-d778687ed4fb (74430653-c391-48b2-989c-d778687ed4fb): created successfully Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcdfaa1-7a02-4f65-81cc-953f09d0a137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:37 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (6a616a77-a656-441a-a6e5-939e3cc183bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:37 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b407f58c-e402-4245-be43-c79d6c3fffc5 tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-af2c5f41-d554-433b-b54e-12d472a09bd6-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Lock "cinder-af2c5f41-d554-433b-b54e-12d472a09bd6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-quobyte-af2c5f41-d554-433b-b54e-12d472a09bd6" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-af2c5f41-d554-433b-b54e-12d472a09bd6" acquired by "delete_volume" :: waited 0.029s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e9c35-bc34-4216-80e9-166c34dbd359]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:38 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 Nov 02 12:02:38 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:38 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6" returned: 0 in 0.422s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:38 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6 Nov 02 12:02:38 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:38 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-af2c5f41-d554-433b-b54e-12d472a09bd6" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:38 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-af2c5f41-d554-433b-b54e-12d472a09bd6" released by "delete_volume" :: held 0.741s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Created reservations ['95a2336c-1000-4c16-becc-a048b6628283', '0ff4ac9c-2e1e-442b-8d4a-c7f656105fdc', 'eba8f908-cacf-4c4c-bc70-43e564d938d1', '0bd6677c-3209-43b9-8bb6-d26f3046e7c7'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:39 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:39 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 of volume 74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5082f3ce-6a22-44ba-a6e6-eb3f35a1e79a]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:39 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb Nov 02 12:02:39 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:39 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.297s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:39 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Deleted volume successfully. Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-be2ac970-ac4b-4bc6-8beb-057481119f3b tempest-ProjectReaderTests-1026918808 None] Lock "cinder-af2c5f41-d554-433b-b54e-12d472a09bd6-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:39 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb" returned: 0 in 0.415s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:39 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 1G Nov 02 12:02:39 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (cf42a77e-f6b0-4142-b956-194f6744326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:39 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0069994-f9af-4ec2-bcf1-ba47d0fce044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0069994-f9af-4ec2-bcf1-ba47d0fce044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533380226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:40Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876364ea-2531-4eaf-91a9-0102751712eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876364ea-2531-4eaf-91a9-0102751712eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f9babb-409a-4870-a98a-65ca466a30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f9babb-409a-4870-a98a-65ca466a30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386', 'volume_name': 'volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0191aef9-f28e-45a3-bdea-5b782aa5026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0191aef9-f28e-45a3-bdea-5b782aa5026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ae073f-c28b-4eea-b1a1-65d7f1799b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:40 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Volume e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386', 'volume_size': 1} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:40 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 1G" returned: 0 in 0.566s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74430653-c391-48b2-989c-d778687ed4fb -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:40 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74430653-c391-48b2-989c-d778687ed4fb -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 Nov 02 12:02:40 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:40 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74430653-c391-48b2-989c-d778687ed4fb -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" returned: 0 in 0.311s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:40 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 is being set with open permissions: ugo+rw Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:40 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 Nov 02 12:02:40 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:40 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:40 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:40 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.info Nov 02 12:02:40 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:41 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.info" returned: 0 in 0.267s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:41 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.info is being set with open permissions: ugo+rw Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:41 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.info Nov 02 12:02:41 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:41 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.info" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533380226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:40Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Creating volume e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:41 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:41 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 1073741824 Nov 02 12:02:41 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:41 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-1e6a5d9b-01af-4f81-baaf-ef4fd30bd5c7 tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:02:41 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 1073741824" returned: 0 in 0.409s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:41 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:41 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 Nov 02 12:02:41 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:42 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ae073f-c28b-4eea-b1a1-65d7f1799b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d569ae-e8a1-408a-8098-5da374b4bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:42 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Volume volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 (e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386): created successfully Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d569ae-e8a1-408a-8098-5da374b4bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (cf42a77e-f6b0-4142-b956-194f6744326d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:42 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-35ea6244-2b01-49a2-86a9-176730835d7f tempest-ProjectReaderTests-1026918808 None] Created volume successfully. Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-74430653-c391-48b2-989c-d778687ed4fb" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-74430653-c391-48b2-989c-d778687ed4fb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 of volume 74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5bcda0-3979-4033-9551-2deb04811006]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:42 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 Nov 02 12:02:42 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:42 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" returned: 0 in 0.418s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74430653-c391-48b2-989c-d778687ed4fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d147e2bc-d288-48c4-9616-63548e9f56b4]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:42 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:43 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb Nov 02 12:02:43 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-quobyte-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386" acquired by "delete_volume" :: waited 0.025s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f9084f-e67e-4915-a0c8-64a5bab88e8f]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:43 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb" returned: 0 in 0.536s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:43 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 Nov 02 12:02:43 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:43 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 Nov 02 12:02:43 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:43 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386" returned: 0 in 0.471s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:43 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386 Nov 02 12:02:43 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:43 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" returned: 0 in 0.431s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:43 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:43 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2 Nov 02 12:02:43 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:44 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386" released by "delete_volume" :: held 0.805s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Created reservations ['d681aa47-180b-4a96-bcbc-1fc7740755c6', '31805ea3-ead5-43c2-ba34-abf7003c43ba', 'a2b0cb9e-5b80-4893-be60-5f27079e2882', '0ec63f3c-434f-4a5f-8518-c38bb7230218'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:44 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb.6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2" released by "_delete_snapshot" :: held 1.836s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-74430653-c391-48b2-989c-d778687ed4fb" released by "delete_snapshot" :: held 1.886s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:44 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:44 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Created reservations ['b78f1957-86d2-45c8-b7d3-c22e664e4a2f', '04ff25b3-3366-4979-9992-efcad02de0af', 'e6045764-1346-4a31-bc17-30d50c0e9779', '95045a2c-a67d-4352-b546-9cce50355dde'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-255e9ded-b625-4be3-92a5-4e85956a931a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-6a56a1d4-5ff5-464f-bcf7-7a5251ac30a2-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-74430653-c391-48b2-989c-d778687ed4fb-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:44 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.320s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:44 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Deleted volume successfully. Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-74430653-c391-48b2-989c-d778687ed4fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-655a57df-9bf9-429c-8a5d-d8b31ba77261 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-e7dd8ce8-58cd-486d-a6ae-de4ffaf2f386-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-74430653-c391-48b2-989c-d778687ed4fb" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-74430653-c391-48b2-989c-d778687ed4fb" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca4404a-772c-4e03-82b4-78bc8b1bc793]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:44 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:44 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb Nov 02 12:02:44 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (b5c3c9f6-ed72-47ee-b404-c1b9b371168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7c2cf1-b0e1-4693-9918-31aaeb9ab75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7c2cf1-b0e1-4693-9918-31aaeb9ab75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492185020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e57c18-f493-4535-a5af-a75ed1cbbeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:45Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95341f5-2d99-4812-aa58-565544b3a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95341f5-2d99-4812-aa58-565544b3a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a99e1d-6247-47bc-90f5-0162e02725bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a99e1d-6247-47bc-90f5-0162e02725bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e57c18-f493-4535-a5af-a75ed1cbbeb1', 'volume_name': 'volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d08fdb-d211-4f36-a0d1-c3d983c54732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d08fdb-d211-4f36-a0d1-c3d983c54732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edca5cf-d558-4f62-a4c2-917e984c3c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:45 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Volume e1e57c18-f493-4535-a5af-a75ed1cbbeb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1', 'volume_size': 1} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492185020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e57c18-f493-4535-a5af-a75ed1cbbeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:45Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Creating volume e1e57c18-f493-4535-a5af-a75ed1cbbeb1 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:45 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:45 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 1073741824 Nov 02 12:02:45 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:45 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb" returned: 0 in 0.449s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:45 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb Nov 02 12:02:45 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:45 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-74430653-c391-48b2-989c-d778687ed4fb" returned: 0 in 0.273s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-74430653-c391-48b2-989c-d778687ed4fb" released by "delete_volume" :: held 0.803s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Created reservations ['94e7fa68-7d77-456f-ac82-2c87a8d8f764', '76e90cf0-1fd4-4b56-85c6-30c806c6da28', '04986d84-d8c0-4b59-bd76-b85065c68ada', '97cc0222-4431-47b9-8e68-febbe26b79fa'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:45 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:45 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:45 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 1073741824" returned: 0 in 0.527s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:45 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 Nov 02 12:02:45 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:45 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.268s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:45 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:45 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8adf0d9e-5d53-4cc9-9586-f81701f371d5 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-74430653-c391-48b2-989c-d778687ed4fb-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:46 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1" returned: 0 in 0.307s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edca5cf-d558-4f62-a4c2-917e984c3c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d2352e-9958-4d24-847c-d3a6529305dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Volume volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 (e1e57c18-f493-4535-a5af-a75ed1cbbeb1): created successfully Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d2352e-9958-4d24-847c-d3a6529305dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (b5c3c9f6-ed72-47ee-b404-c1b9b371168d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:46 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-c83c8925-3982-4b84-97be-45143bc3365f tempest-ProjectReaderTests-1026918808 None] Created volume successfully. Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (51c7402a-dc1d-46b1-b75c-418390521283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2f840e-5165-4123-9591-9e1fe65fc5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2f840e-5165-4123-9591-9e1fe65fc5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402845185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff80bbe6-a7db-441f-93fd-6881eeed138b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:46Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4fefca-9161-4c37-8bbd-0c8f03d2a402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4fefca-9161-4c37-8bbd-0c8f03d2a402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9344cfc-96bf-4eeb-9500-754167847eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9344cfc-96bf-4eeb-9500-754167847eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff80bbe6-a7db-441f-93fd-6881eeed138b', 'volume_name': 'volume-ff80bbe6-a7db-441f-93fd-6881eeed138b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5e1831-c1ba-4095-832a-c0dd1794e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5e1831-c1ba-4095-832a-c0dd1794e067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9a114b-3cd1-48a3-b46c-c0fc27f3a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:46 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Volume ff80bbe6-a7db-441f-93fd-6881eeed138b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff80bbe6-a7db-441f-93fd-6881eeed138b', 'volume_size': 1} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402845185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff80bbe6-a7db-441f-93fd-6881eeed138b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:46Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Creating volume ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:46 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:46 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b 1073741824 Nov 02 12:02:46 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:46 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b 1073741824" returned: 0 in 0.403s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:46 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:46 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b Nov 02 12:02:46 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:47 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b" returned: 0 in 0.241s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9a114b-3cd1-48a3-b46c-c0fc27f3a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff80bbe6-a7db-441f-93fd-6881eeed138b', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009d67d1-7968-4e99-afc8-0abeda390964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:47 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Volume volume-ff80bbe6-a7db-441f-93fd-6881eeed138b (ff80bbe6-a7db-441f-93fd-6881eeed138b): created successfully Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009d67d1-7968-4e99-afc8-0abeda390964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (51c7402a-dc1d-46b1-b75c-418390521283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:47 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-d918ed3f-ee03-4253-8d92-a40b8eeae075 tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-e1e57c18-f493-4535-a5af-a75ed1cbbeb1-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-e1e57c18-f493-4535-a5af-a75ed1cbbeb1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-quobyte-e1e57c18-f493-4535-a5af-a75ed1cbbeb1" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-e1e57c18-f493-4535-a5af-a75ed1cbbeb1" acquired by "delete_volume" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[69134166-fcc9-4faa-89ec-16c2733e255b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:47 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 Nov 02 12:02:47 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 3e649e07-380b-4f9e-9a7f-de074901356f of volume ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd58eb5-5e1d-4bca-86ef-cd0fe33f0023]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:47 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b Nov 02 12:02:47 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:47 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1" returned: 0 in 0.380s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:47 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1 Nov 02 12:02:47 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:47 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b" returned: 0 in 0.367s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:47 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f 1G Nov 02 12:02:47 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:47 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-e1e57c18-f493-4535-a5af-a75ed1cbbeb1" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:47 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-e1e57c18-f493-4535-a5af-a75ed1cbbeb1" released by "delete_volume" :: held 0.676s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Created reservations ['193e338a-dbef-4b27-8a52-ccc9e4bfe972', 'b80ed8ae-4313-4621-8edd-8013d485eb9b', '71dbeeb1-fb80-421f-9699-332efd6a2ae2', '6055a227-0ff6-4872-b6e6-cfda609b9988'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:48 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:48 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:48 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.272s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:48 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Deleted volume successfully. Nov 02 12:02:48 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f 1G" returned: 0 in 0.469s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff80bbe6-a7db-441f-93fd-6881eeed138b -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8f8f1127-a212-4ed6-9ef5-44540bbd5ab6 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-e1e57c18-f493-4535-a5af-a75ed1cbbeb1-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:48 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff80bbe6-a7db-441f-93fd-6881eeed138b -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f Nov 02 12:02:48 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:48 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff80bbe6-a7db-441f-93fd-6881eeed138b -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f" returned: 0 in 0.321s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:48 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f is being set with open permissions: ugo+rw Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:48 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f Nov 02 12:02:48 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (b9f1db1c-6235-4910-a4c9-078eabca7f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28e9239-b507-4fe4-9a54-d91c4388f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28e9239-b507-4fe4-9a54-d91c4388f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521785589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1574b5-11b5-41ae-8a5e-02c613fc1ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:49Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec04e93-7161-4bb7-b441-93c614af80f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec04e93-7161-4bb7-b441-93c614af80f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff523ec-bbde-46b5-9273-2329e1eb95ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff523ec-bbde-46b5-9273-2329e1eb95ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1574b5-11b5-41ae-8a5e-02c613fc1ac4', 'volume_name': 'volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edf1fc6-19b2-45f5-b164-abedca1a23cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edf1fc6-19b2-45f5-b164-abedca1a23cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffd608e-d10f-4426-b482-7e6419a9bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:48 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Volume ab1574b5-11b5-41ae-8a5e-02c613fc1ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4', 'volume_size': 1} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:48 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f" returned: 0 in 0.263s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:48 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:49 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.info Nov 02 12:02:49 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:49 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.info" returned: 0 in 0.244s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:49 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.info is being set with open permissions: ugo+rw Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:49 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.info Nov 02 12:02:49 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:49 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.info" returned: 0 in 0.240s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.550s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521785589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1574b5-11b5-41ae-8a5e-02c613fc1ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230c0c3bd68146168e4f8c1278b90cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:49Z,use_quota=True,user_id='516030c9cecd496b916b12dc0b262105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Creating volume ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:49 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:49 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 1073741824 Nov 02 12:02:49 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:49 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-06dcca7e-9f33-4a6d-8a82-8d996ab6a7b2 tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:02:49 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 1073741824" returned: 0 in 0.426s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:49 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:49 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 Nov 02 12:02:49 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:50 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4" returned: 0 in 0.250s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffd608e-d10f-4426-b482-7e6419a9bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451f4ca0-d1cd-4e8b-9371-97fca28969be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:50 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Volume volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 (ab1574b5-11b5-41ae-8a5e-02c613fc1ac4): created successfully Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451f4ca0-d1cd-4e8b-9371-97fca28969be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Flow 'volume_create_manager' (b9f1db1c-6235-4910-a4c9-078eabca7f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:50 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-51b45459-2d20-4954-a0b3-301f0a0723dd tempest-ProjectReaderTests-1026918808 None] Created volume successfully. Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-3e649e07-380b-4f9e-9a7f-de074901356f-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-3e649e07-380b-4f9e-9a7f-de074901356f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-ff80bbe6-a7db-441f-93fd-6881eeed138b" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff80bbe6-a7db-441f-93fd-6881eeed138b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-3e649e07-380b-4f9e-9a7f-de074901356f" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-3e649e07-380b-4f9e-9a7f-de074901356f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 3e649e07-380b-4f9e-9a7f-de074901356f of volume ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8c54f-c6ea-4885-9a22-68dca6b8c388]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:50 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f Nov 02 12:02:50 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:50 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "cinder-quobyte-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56d406-0554-4863-8766-df7907971f3b]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:51 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f" returned: 0 in 0.382s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff80bbe6-a7db-441f-93fd-6881eeed138b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba71672-9de0-4e03-be80-db1605089a06]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:51 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 Nov 02 12:02:51 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:51 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b Nov 02 12:02:51 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:51 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4" returned: 0 in 0.362s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:51 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4 Nov 02 12:02:51 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:51 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b" returned: 0 in 0.376s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:51 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f Nov 02 12:02:51 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:51 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4" returned: 0 in 0.246s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-quobyte-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4" released by "delete_volume" :: held 0.657s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Created reservations ['02210ed9-fb7b-4477-881f-46390695434f', '88b8f8e0-433b-49f1-b60b-3e5fb618ee5e', 'a008180f-56a7-47e2-af6b-27e21a10f573', 'cd8e7ce7-6b37-4394-a0a4-b050e75e48cf'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:51 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:51 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:51 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f" returned: 0 in 0.341s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:51 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:51 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f Nov 02 12:02:51 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:52 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Deleted volume successfully. Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-5b645b28-02cc-4d8e-89b5-f3a737200e38 tempest-ProjectReaderTests-1026918808 None] Lock "cinder-ab1574b5-11b5-41ae-8a5e-02c613fc1ac4-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:52 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b.3e649e07-380b-4f9e-9a7f-de074901356f" returned: 0 in 0.260s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-3e649e07-380b-4f9e-9a7f-de074901356f" released by "_delete_snapshot" :: held 1.455s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff80bbe6-a7db-441f-93fd-6881eeed138b" released by "delete_snapshot" :: held 1.482s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Created reservations ['f910537b-0927-4c09-8daa-1aa7cf389e93', '3c7814c4-3c63-47f3-95fc-66e563a1ba67', 'bb9ae781-a8cb-4fbf-b709-9d9bb6abfb63', '3f4bfcb7-2685-4a24-b7e3-e7dbb34b8723'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:52 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-f2febacd-f373-4841-9432-56f26ecf693a tempest-ProjectMemberTests-1390221521 None] Lock "cinder-3e649e07-380b-4f9e-9a7f-de074901356f-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-ff80bbe6-a7db-441f-93fd-6881eeed138b-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-ff80bbe6-a7db-441f-93fd-6881eeed138b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-ff80bbe6-a7db-441f-93fd-6881eeed138b" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff80bbe6-a7db-441f-93fd-6881eeed138b" acquired by "delete_volume" :: waited 0.020s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3900df9-63bd-4ccc-8be3-41ffe8f2b285]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:52 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:53 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b Nov 02 12:02:53 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:53 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b" returned: 0 in 0.411s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:53 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b Nov 02 12:02:53 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:53 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-ff80bbe6-a7db-441f-93fd-6881eeed138b" returned: 0 in 0.255s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-ff80bbe6-a7db-441f-93fd-6881eeed138b" released by "delete_volume" :: held 0.731s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Created reservations ['6725a679-80b6-4bfa-90af-7fcf7aedbe33', '77424af6-c753-47a8-bc4f-34f7d78bc90a', 'fa928db0-8d4f-4ec0-9ac1-9ab269e32f6f', 'f8d774e4-f0f9-4f6d-b6e1-adfb3d601ad6'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:53 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:53 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:02:53 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:54 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:02:54 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-8325928b-b0a1-47d1-9aa1-4f3b5ec2f051 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-ff80bbe6-a7db-441f-93fd-6881eeed138b-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (d2dbb208-4a33-45cb-a8b6-94b031de4f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27b1ba5-8ffb-4094-becb-87a5bcecd15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27b1ba5-8ffb-4094-becb-87a5bcecd15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969015834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73efd482-969c-43d6-94d3-55716cf3c415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:54Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258419fa-8ab8-4cf0-84bd-c6b7a1fb1d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258419fa-8ab8-4cf0-84bd-c6b7a1fb1d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775227f4-a9b1-4572-9144-9eb1ac779b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775227f4-a9b1-4572-9144-9eb1ac779b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73efd482-969c-43d6-94d3-55716cf3c415', 'volume_name': 'volume-73efd482-969c-43d6-94d3-55716cf3c415', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f040aae8-edf2-424b-be1f-dc7c1bf78688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f040aae8-edf2-424b-be1f-dc7c1bf78688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea098d2-0e1c-496d-9371-17ffc4154277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:54 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Volume 73efd482-969c-43d6-94d3-55716cf3c415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73efd482-969c-43d6-94d3-55716cf3c415', 'volume_size': 1} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969015834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73efd482-969c-43d6-94d3-55716cf3c415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:02:54Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Creating volume 73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:02:54 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:54 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 1073741824 Nov 02 12:02:54 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:54 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 1073741824" returned: 0 in 0.393s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:54 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:55 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 Nov 02 12:02:55 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:55 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea098d2-0e1c-496d-9371-17ffc4154277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73efd482-969c-43d6-94d3-55716cf3c415', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd31301-f91e-4212-b1b7-29cefb68c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:02:55 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Volume volume-73efd482-969c-43d6-94d3-55716cf3c415 (73efd482-969c-43d6-94d3-55716cf3c415): created successfully Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd31301-f91e-4212-b1b7-29cefb68c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (d2dbb208-4a33-45cb-a8b6-94b031de4f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:02:55 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-412710cd-ba95-4167-b257-68228f183d09 tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 9028fcef-65ca-4368-9118-04a22f72f273 of volume 73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[a716b4e8-912b-412e-915c-805a08db141e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:55 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:55 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 Nov 02 12:02:55 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:56 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:56 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 1G Nov 02 12:02:56 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:56 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 1G" returned: 0 in 0.373s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73efd482-969c-43d6-94d3-55716cf3c415 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:56 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73efd482-969c-43d6-94d3-55716cf3c415 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 Nov 02 12:02:56 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:56 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73efd482-969c-43d6-94d3-55716cf3c415 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273" returned: 0 in 0.278s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:56 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 is being set with open permissions: ugo+rw Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:56 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 Nov 02 12:02:56 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:56 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273" returned: 0 in 0.243s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:56 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:56 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.info Nov 02 12:02:56 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:57 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.info" returned: 0 in 0.252s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:57 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.info is being set with open permissions: ugo+rw Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:57 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.info Nov 02 12:02:57 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:57 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.info" returned: 0 in 0.235s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:02:57 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-20ecf4b5-5efd-4a45-9af0-3e783663474f tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-9028fcef-65ca-4368-9118-04a22f72f273-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-9028fcef-65ca-4368-9118-04a22f72f273-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-73efd482-969c-43d6-94d3-55716cf3c415" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-73efd482-969c-43d6-94d3-55716cf3c415" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-9028fcef-65ca-4368-9118-04a22f72f273" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-9028fcef-65ca-4368-9118-04a22f72f273" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 9028fcef-65ca-4368-9118-04a22f72f273 of volume 73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[240c5dfa-f824-4a1f-96f0-4f7afa93b597]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:57 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:57 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 Nov 02 12:02:57 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:58 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273" returned: 0 in 0.347s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73efd482-969c-43d6-94d3-55716cf3c415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd85b9ce-d213-4b86-99ea-f4e3011a7eb3]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:58 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 Nov 02 12:02:58 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:58 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415" returned: 0 in 0.366s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:58 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 Nov 02 12:02:58 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:58 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273" returned: 0 in 0.325s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:58 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:02:58 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273 Nov 02 12:02:58 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:02:59 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415.9028fcef-65ca-4368-9118-04a22f72f273" returned: 0 in 0.236s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-9028fcef-65ca-4368-9118-04a22f72f273" released by "_delete_snapshot" :: held 1.368s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-73efd482-969c-43d6-94d3-55716cf3c415" released by "delete_snapshot" :: held 1.390s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Created reservations ['32b0d99e-ba5c-416e-9b64-6e6e6b7a2ad2', '520660ca-b49f-4dac-9603-ee64a6c57fe3', '453b776b-96e9-4e05-89ee-202921c42437', '5a7dc79b-9c30-4b11-ada3-bbf6a514b06b'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:02:59 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dad02a08-b40c-40a2-a2d1-ed2f4132e8a6 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-9028fcef-65ca-4368-9118-04a22f72f273-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-73efd482-969c-43d6-94d3-55716cf3c415-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-73efd482-969c-43d6-94d3-55716cf3c415-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:02:59 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-73efd482-969c-43d6-94d3-55716cf3c415" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-73efd482-969c-43d6-94d3-55716cf3c415" acquired by "delete_volume" :: waited 0.014s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[64721389-d3af-4570-8ec9-39ba14e7e805]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:00 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 Nov 02 12:03:00 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:00 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415" returned: 0 in 0.352s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:00 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415 Nov 02 12:03:00 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:00 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-73efd482-969c-43d6-94d3-55716cf3c415" returned: 0 in 0.259s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-73efd482-969c-43d6-94d3-55716cf3c415" released by "delete_volume" :: held 0.671s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Created reservations ['6e4dad18-f3eb-4651-b2b7-594c0f72d616', '250840b8-f136-4b3f-b241-94c5d6983a00', 'a057cbcc-7456-43d8-a2dd-75bd1ade8971', 'e82bbef7-4f9a-4fa0-af04-b75eec9e739c'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:03:00 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:00 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:03:00 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:01 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.234s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:03:01 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-fdfc167b-52ec-4a16-8199-73fd75416a90 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-73efd482-969c-43d6-94d3-55716cf3c415-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.flows.manager.create_volume [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86846) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (e10c230e-7ded-42fd-a15b-9f509f0c20ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cb96fb-83df-4fcb-ac6f-f8f2695484ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cb96fb-83df-4fcb-ac6f-f8f2695484ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25999455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d11ae8-ebb3-4e9b-8abb-827d17f2be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:03:01Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704af23-f17e-46d3-b6cd-e10334a6ff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704af23-f17e-46d3-b6cd-e10334a6ff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af2d135-0e34-432f-b7a1-9e4c2863fd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af2d135-0e34-432f-b7a1-9e4c2863fd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d11ae8-ebb3-4e9b-8abb-827d17f2be49', 'volume_name': 'volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6265437-f282-44bc-bfec-67bca7ab9ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6265437-f282-44bc-bfec-67bca7ab9ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4da74df-6a04-4e68-92aa-e53124a9e5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:03:01 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Volume d8d11ae8-ebb3-4e9b-8abb-827d17f2be49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49', 'volume_size': 1} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25999455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d11ae8-ebb3-4e9b-8abb-827d17f2be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c208666ae04a8db57e5d2bdc07b4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:03:01Z,use_quota=True,user_id='5727d389a3414d4b83fdb26fd82f36a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052b53bf-295b-45ee-9ebd-333d248039c0),volume_type_id=052b53bf-295b-45ee-9ebd-333d248039c0)}" {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Creating volume d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Selected osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf as target Quobyte volume. {{(pid=86846) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:03:01 devstack cinder-volume[86846]: INFO cinder.volume.drivers.remotefs [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] casted to osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf Nov 02 12:03:01 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 1073741824 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:01 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 1073741824 Nov 02 12:03:01 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:02 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 1073741824" returned: 0 in 0.420s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:02 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 Nov 02 12:03:02 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:02 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'} {{(pid=86846) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4da74df-6a04-4e68-92aa-e53124a9e5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49', 'volume_size': 1}' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38c31e9-668d-4727-8e48-8530084c9303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:03:02 devstack cinder-volume[86846]: INFO cinder.volume.flows.manager.create_volume [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Volume volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 (d8d11ae8-ebb3-4e9b-8abb-827d17f2be49): created successfully Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38c31e9-668d-4727-8e48-8530084c9303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86846) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Flow 'volume_create_manager' (e10c230e-7ded-42fd-a15b-9f509f0c20ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86846) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:03:02 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-215ced53-0ee2-4505-9c1c-231a6ffcf872 tempest-ProjectMemberTests-1390221521 None] Created volume successfully. Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Creating offline snapshot 601b5cd0-766c-4fc6-b543-2e89049adae2 of volume d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[928f8688-a615-4ffc-8a6b-4785587f8343]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:03:02 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:02 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 Nov 02 12:03:02 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:03 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" returned: 0 in 0.349s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 1G {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:03 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 1G Nov 02 12:03:03 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:03 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 1G" returned: 0 in 0.387s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:03 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 Nov 02 12:03:03 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:03 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 -F qcow2 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2" returned: 0 in 0.307s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:03 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 is being set with open permissions: ugo+rw Nov 02 12:03:03 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:03 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 Nov 02 12:03:03 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:04 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2" returned: 0 in 0.233s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:04 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.info Nov 02 12:03:04 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:04 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.info" returned: 0 in 0.237s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:04 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.remotefs [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.info is being set with open permissions: ugo+rw Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.info {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:04 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.info Nov 02 12:03:04 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:04 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.info" returned: 0 in 0.224s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:03:04 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6fc5f898-bdf6-462d-822d-eb26495a1c0a tempest-ProjectMemberTests-1390221521 None] Create snapshot completed successfully Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-601b5cd0-766c-4fc6-b543-2e89049adae2-delete_snapshot" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-601b5cd0-766c-4fc6-b543-2e89049adae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" by "delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-601b5cd0-766c-4fc6-b543-2e89049adae2" by "_delete_snapshot" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-601b5cd0-766c-4fc6-b543-2e89049adae2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:03:04 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Deleting offline snapshot 601b5cd0-766c-4fc6-b543-2e89049adae2 of volume d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] snapshot_file for this snap is: volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 {{(pid=86846) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd922c-5455-4b82-bb06-8b9d1045e37e]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:05 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 Nov 02 12:03:05 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:05 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2" returned: 0 in 0.344s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86846) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5645e8-1e4f-4156-9ed9-3949f93fb223]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:05 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 Nov 02 12:03:05 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:05 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" returned: 0 in 0.340s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:05 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:05 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 Nov 02 12:03:05 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:06 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2" returned: 0 in 0.313s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:06 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2 Nov 02 12:03:06 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:06 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:06 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49.601b5cd0-766c-4fc6-b543-2e89049adae2" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-601b5cd0-766c-4fc6-b543-2e89049adae2" released by "_delete_snapshot" :: held 1.318s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:03:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" released by "delete_snapshot" :: held 1.335s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:03:06 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Created reservations ['7b96a1b7-3e23-4c18-ac0c-e63b3b65891a', '87b1bf21-57aa-4570-8835-0f0b281453f1', 'e7d648d8-83e1-488b-939f-7adfed7a06e1', '3d86e690-8d7a-4e16-9056-4a6898df80f8'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:03:06 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Delete snapshot completed successfully. Nov 02 12:03:06 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-dd3cda1a-202c-4aca-9117-b535cb2317a4 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-601b5cd0-766c-4fc6-b543-2e89049adae2-delete_snapshot" released by "delete_snapshot" :: held 1.457s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49-delete_volume" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "cinder-quobyte-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" by "delete_volume" {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" acquired by "delete_volume" :: waited 0.013s {{(pid=86846) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a7646f-a653-4269-bc54-35626be7af03]: (4, 'qcow2') {{(pid=88701) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:07 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 Nov 02 12:03:07 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:07 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" returned: 0 in 0.348s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:07 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49 Nov 02 12:03:07 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:07 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062/volume-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" returned: 0 in 0.232s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-quobyte-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49" released by "delete_volume" :: held 0.637s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.quota [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Created reservations ['f1513b21-d5b0-4adb-81d0-53917518de4e', '05a0bb24-3454-4241-a1b9-dbef2a9c3b8d', '79f84ab9-994d-4385-b681-ed58a583f89d', '6f11043d-365b-4aa2-8d43-23077705dafb'] {{(pid=86846) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:03:07 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:08 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:03:08 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:08 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:08 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.240s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:08 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:03:08 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Deleted volume successfully. Nov 02 12:03:08 devstack cinder-volume[86846]: DEBUG cinder.coordination [None req-6e624190-046a-4070-b204-1513a63f57d9 tempest-ProjectMemberTests-1390221521 None] Lock "cinder-d8d11ae8-ebb3-4e9b-8abb-827d17f2be49-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86846) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:03:17 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=94,cinder:INSERT=28,cinder:UPDATE=126,cinder:DELETE=8 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:INSERT=36,cinder:UPDATE=120,cinder:SELECT=79,cinder:DELETE=13 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a123d32d-d018-44ef-8343-4d10056871cf'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:03:18 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:03:18 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062 Nov 02 12:03:18 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:03:19 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 02 12:03:19 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee7031fd9a0bb8d4c17d54a85d111062" returned: 0 in 0.242s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:03:19 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:03:19 devstack cinder-volume[86846]: DEBUG oslo_service.periodic_task [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86846) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:03:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread count: 29 {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:03:19 devstack cinder-volume[86846]: DEBUG cinder.volume.manager [None req-74cad4a5-658a-4000-8eae-186facaca6c5 None None] thread info: [<_MainThread(MainThread, started 134106118578304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86846) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}